-- Logs begin at Fri 2022-09-09 03:59:36 UTC, end at Fri 2022-09-09 04:59:23 UTC. -- Sep 09 04:30:18.824269 dv-cinder-856002-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 04:30:18 2022] *** Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: nodename: dv-cinder-856002-3-iscsi Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: machine: x86_64 Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: clock source: unix Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: pcre jit disabled Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: detected number of CPU cores: 4 Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: current working directory: / Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: detected binary path: /usr/bin/uwsgi-core Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: your processes number limit is 47680 Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: your memory page size is 4096 bytes Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: detected max file descriptor number: 2048 Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: lock engine: pthread robust mutexes Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: thunder lock: enabled Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 04:30:18.837383 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 04:30:18.874799 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: Python main interpreter initialized at 0x55d651bf79c0 Sep 09 04:30:18.874799 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: python threads support enabled Sep 09 04:30:18.874799 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: your server socket listen backlog is limited to 100 connections Sep 09 04:30:18.874799 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: your mercy for graceful operations on workers is 90 seconds Sep 09 04:30:18.875182 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 04:30:18.875264 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: *** Operational MODE: preforking *** Sep 09 04:30:18.875503 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: *** uWSGI is running in multiple interpreter mode *** Sep 09 04:30:18.875503 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: spawned uWSGI master process (pid: 106450) Sep 09 04:30:18.875698 dv-cinder-856002-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 04:30:18.878970 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: spawned uWSGI worker 1 (pid: 106455, cores: 1) Sep 09 04:30:18.878970 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: spawned uWSGI worker 2 (pid: 106456, cores: 1) Sep 09 04:30:18.878970 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 04:30:19.529523 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 04:30:19.537873 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 04:30:20.613343 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:30:20.613343 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: from cryptography.utils import int_from_bytes Sep 09 04:30:20.613924 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:30:20.613924 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: from cryptography.utils import int_from_bytes Sep 09 04:30:20.620160 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:30:20.620160 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: from cryptography.utils import int_from_bytes Sep 09 04:30:20.620626 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:30:20.620626 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: from cryptography.utils import int_from_bytes Sep 09 04:30:23.115032 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 04:30:23.115590 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 04:30:23.115798 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 04:30:23.116154 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 04:30:23.116405 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 04:30:23.116783 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.117101 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.117318 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 04:30:23.117690 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.117783 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 04:30:23.117866 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.118031 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.118130 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 04:30:23.118336 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.118426 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 04:30:23.118650 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.118740 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 04:30:23.118983 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.119076 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.119307 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.119399 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.119564 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.119695 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.119875 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.120020 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.120191 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-3-iscsi {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.120350 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.120505 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.120660 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.120808 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.120982 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.121110 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.121300 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.121443 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.121627 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.121718 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.121889 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.122002 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.122203 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.122299 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.122526 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-3-iscsi {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.122778 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.123188 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.123188 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.123421 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.123551 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.123681 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.123801 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.123911 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.124053 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.124176 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.124373 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.124508 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.124677 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.124774 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.124998 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.125768 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.125874 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.126093 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.126194 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.126405 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.126550 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.126717 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.126832 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-3-iscsi {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.127081 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.127182 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.127395 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.127506 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.127707 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.127812 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.128044 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.128155 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.128334 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.128446 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.128656 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.128747 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.128966 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.129055 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.129297 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.129467 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-3-iscsi {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.129599 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.129699 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.129918 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.130008 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.130228 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.130326 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.130538 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.130659 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.130852 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.131000 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.131170 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.131314 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.131472 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.131634 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.131775 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.131969 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.132116 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.132288 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.132394 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.132574 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.132666 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.132892 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.132980 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.133192 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.133294 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.133507 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.133596 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.133806 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.133894 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.134112 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.134211 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.134356 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.134446 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.134598 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.134735 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.134908 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.135062 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.135241 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.135371 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.135545 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.135636 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.135846 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.135945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.136146 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.136235 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.136458 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.136602 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.136748 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.136848 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.137074 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.137164 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.137327 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.137430 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.137649 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.137750 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.137966 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.138103 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.138276 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.138375 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.138583 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.138672 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.138892 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.139014 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.139227 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.139319 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.139536 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.139627 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.139844 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.139934 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.140144 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.140234 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.140450 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.140546 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.140812 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.140917 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.141090 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.141187 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.141404 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.141503 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.141709 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.141796 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.142011 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.142107 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.142311 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.142401 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.142614 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.142711 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.142958 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.143063 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.143273 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.143370 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.143570 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.143669 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.143817 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.143906 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.144113 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.144201 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.144410 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.144508 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.144721 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.144814 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.145023 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.145112 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.145323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.145420 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.145621 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.145710 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.145912 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.146001 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.146212 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.146302 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.146508 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.146602 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.146805 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.146895 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.147127 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.147219 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.147426 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.147514 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.147733 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.147849 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.148030 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.148150 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.148333 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.148442 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.148627 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.148724 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.148923 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.149030 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.149225 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.149321 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.149529 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.149639 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.149825 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.149928 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.150121 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.150232 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.150421 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.150519 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.150719 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.150816 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.151051 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.151148 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.151351 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.151439 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.151650 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.151741 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.151962 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.152059 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.152260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.152362 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.152558 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.152647 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.152859 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.152980 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.153158 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.153263 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.153455 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.153546 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.153765 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.153855 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.154058 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.154220 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.154358 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.154447 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.154667 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.154757 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.154986 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.155101 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.155287 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.155378 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.155583 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.155671 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.155881 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.155978 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.156178 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.156269 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.156499 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.156590 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.156797 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.156898 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.157091 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.157186 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.157384 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.157473 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.157698 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.157788 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158003 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158096 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158300 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158388 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158600 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158688 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158892 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.158995 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.159221 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.159309 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.159522 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.159614 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.159824 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.159912 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.160128 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.160237 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.160443 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.160532 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.160764 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.160861 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.161072 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.161170 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.161378 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.161467 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.161683 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.161778 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.161992 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.162090 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:30:23.162313 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.162410 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.162618 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.162707 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.162922 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.163040 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.163249 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.163346 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.163564 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.163653 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.163878 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.163969 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.164202 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.164301 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.164514 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.164620 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.164823 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.164913 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.165134 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.165234 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.165439 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.165530 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.165746 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.165837 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.166058 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.166156 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.166368 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.166455 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.166673 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.166772 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.167024 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.167123 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.167343 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.167432 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.167652 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.167754 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.167966 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.168054 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.168277 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.168376 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.168579 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.168677 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.168884 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.168977 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.169190 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.169293 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.169509 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.169597 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.169817 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.169906 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.170122 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.170220 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.170433 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.170522 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.170738 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.170828 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.171080 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.171187 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.171387 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.171488 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.171689 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.171778 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.172009 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.172958 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.173049 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.173132 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.173212 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.173427 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.173529 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.173733 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.173985 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.174074 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.174342 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.174570 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.174675 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.174960 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.175151 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.175270 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.175690 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.176003 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.176328 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.176682 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.176760 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.177070 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.177256 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.177421 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.177626 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.177764 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.178154 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.178312 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.178466 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.178770 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.179355 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.179695 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.179816 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.180032 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.180166 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.180368 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.180511 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.180695 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.180845 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.181020 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.181156 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.181343 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.181728 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.181909 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.182046 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.182221 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.182360 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.182535 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.182673 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.182852 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.183055 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.183218 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.183368 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.183519 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.183660 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.183821 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.183972 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.184112 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.184257 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.184443 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.184609 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.184760 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.184932 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.185070 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.185252 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.185603 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.186201 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.186350 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.186491 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.186643 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.186795 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.186959 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.187106 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.187246 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.187383 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.187520 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.187719 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.187884 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.188024 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.188162 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.188300 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.188448 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.188588 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.188726 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.188865 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.189568 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.189775 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.189940 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.190077 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.190225 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.190360 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.190496 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.190639 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.190783 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.190920 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.191094 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.191231 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.191365 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.191499 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.191654 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.191790 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.191933 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.192092 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.192229 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.192229 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.192493 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.192629 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.192764 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.192898 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.193032 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.193175 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.193311 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.193445 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.193580 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.193714 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.193859 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194002 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194138 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194273 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194414 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194550 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194692 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194835 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.194985 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.195117 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.195251 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.195384 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.195539 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.195686 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.195821 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.195963 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.196119 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.196206 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.196297 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.196389 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.196502 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.196689 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.196807 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.197007 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.197107 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.197314 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.197403 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.197625 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.197713 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.197929 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.198026 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.198237 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.198326 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.198545 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.198633 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.198901 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.199106 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.199201 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.199284 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.199486 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.199588 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.199806 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.199904 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.200111 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.200215 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.200429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.200539 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.200736 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.200833 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.201050 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.201154 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.201351 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.201458 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.201662 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.201760 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.201988 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.202083 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.202302 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.202398 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.202611 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.202706 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.202923 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.203038 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.203249 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.203400 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.203582 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.203680 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.203887 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.203984 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.204191 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.204296 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.204499 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.204604 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.204805 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.204908 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.205117 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.205222 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.205421 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.205519 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.205734 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.205830 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.206038 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.206158 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.206353 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.206451 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.206656 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.206747 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.206988 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.207082 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.207289 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.207386 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.207598 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.207687 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.207907 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.207996 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.208219 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.208314 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.208520 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.208618 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.208845 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.208949 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.209148 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.209250 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.209444 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.209531 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.209747 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.209835 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.210058 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.210152 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.210358 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.210454 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.210660 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.210757 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.210987 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.211090 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.211303 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.211400 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.211610 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.211697 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.211914 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.212009 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.212213 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.212310 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.212521 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.212618 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.212823 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.212912 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.213123 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.213219 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.213421 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.213509 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.213727 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.213812 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.214037 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.214126 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.214339 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.214425 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.214651 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.214738 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.214981 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.215084 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.215284 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.215373 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.215585 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.215681 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.215899 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.216044 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.216200 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.216339 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.216499 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.216635 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.216800 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.216936 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.217091 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.217226 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.217415 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.217554 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.217701 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.217833 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.218003 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.218139 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.218314 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.218458 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.218629 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.218770 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.218968 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.219154 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.219300 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.219458 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.219604 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.219742 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.219890 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.220025 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.220317 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.220453 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.220588 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.220754 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.220896 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.221060 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.221206 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.221364 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.221502 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.221668 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.221800 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.221974 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.222107 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.222289 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.222418 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.222590 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.222720 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.222896 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.223098 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.223233 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.223368 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.223504 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.223638 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.223786 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.223919 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.224096 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.224232 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.224433 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.224662 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.224813 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.224991 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.225123 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.225301 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.225436 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.225616 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.225760 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.225942 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.226083 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.226255 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.226398 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.226567 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.226712 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.226855 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.227028 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.227197 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.227328 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.227500 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.227650 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.227806 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.228063 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.228194 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.228394 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.228526 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.228700 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.228837 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229001 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229151 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229286 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229401 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229587 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229691 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229894 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.229983 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.230192 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.230280 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.230493 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.230590 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.230791 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.230882 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.231187 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.231276 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.231496 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.231594 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.231794 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.231890 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.232118 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.232253 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.232444 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.232564 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.232698 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.232814 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.232999 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.233113 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.233297 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.233415 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.233596 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.233710 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.233895 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.234017 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.234196 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.234310 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.234502 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.235139 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.235363 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.235489 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.235669 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.235789 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.235984 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.236107 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.236289 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.236416 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.236586 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.236709 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.236905 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.237027 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.237204 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.237378 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.237492 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.237599 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.237785 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.237900 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.238126 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.238225 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.238431 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.238519 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.238767 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.238855 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.239097 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.239188 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.239445 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.239547 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.239704 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.239792 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.240015 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.240105 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.240313 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.240401 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.240617 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.240705 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.240917 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.241006 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.241226 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.241320 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.241528 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.241615 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.241826 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.241916 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.242125 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.242213 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.242426 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.242521 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.242729 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.242817 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.243048 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.243151 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.243352 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.243455 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.243649 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.243738 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.243955 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.244041 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.244251 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.244350 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.244548 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.244636 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.244847 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.244936 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.245146 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.245246 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.245446 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.245533 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.245742 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.245837 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.246047 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.246143 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.246350 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.246443 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.246649 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.246741 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.246962 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.247054 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.247268 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.247366 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.247566 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.247655 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.247864 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.247953 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.248165 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.248251 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.248471 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.248558 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.248778 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.248866 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.249078 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.249163 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.249396 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.249509 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.249677 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.249809 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.249984 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.250087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.250822 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.250953 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.251159 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.251259 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.251459 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.251569 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.251761 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.251870 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.252059 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.252164 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.252359 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.252465 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.252657 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.252765 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.252973 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.253079 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.253273 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.253377 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.253574 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.253686 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.253874 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.253972 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.254174 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.254272 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.254480 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.254584 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.254784 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.254882 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.255117 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.255216 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.255422 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.255515 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.255728 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.255824 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.256035 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.256133 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.256345 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.256499 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.256638 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.256781 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.256927 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.257073 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.257219 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.257364 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.257610 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.257749 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.257893 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.258039 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.258177 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.258313 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.258455 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.258593 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.258728 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.258872 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.259039 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.259178 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.259324 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.259479 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.259689 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.259926 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.260069 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.260207 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.260342 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.260478 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.260622 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.260769 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.261422 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.261509 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.261589 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.261669 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.261828 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.261913 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.261993 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262072 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262160 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262250 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262332 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262412 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262556 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262748 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.262864 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.263105 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.263224 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.263432 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.263524 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.263758 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.263853 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.264085 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.264175 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.264392 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.264487 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.264699 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.264793 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.265001 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.265098 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.265306 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.265402 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.265615 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.265720 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.265942 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.266031 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.266247 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.266334 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.266549 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.266646 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.266857 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.266963 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.267181 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.267270 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.267496 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.267601 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.267803 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.267904 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.268114 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.268266 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.268427 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.268530 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.268734 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.268823 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.269059 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.269156 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.269367 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.269455 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.269680 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.269811 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.269979 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.270109 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.270282 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.270393 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.270597 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.270698 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.270907 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.271032 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.271290 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.271388 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.271589 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.271680 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.271888 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.271978 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.272196 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.272291 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.272516 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.272620 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.272816 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.272918 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.273117 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.273208 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.273417 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.273508 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.273732 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.273831 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.274031 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.274145 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.274346 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.274458 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.274754 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.274852 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.275082 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.275174 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.275384 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.275475 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.275686 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.275783 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.275998 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.276097 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.276322 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.276411 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.276645 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.276737 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.276932 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.277030 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.277237 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.277325 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.277557 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.277648 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.277860 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.277955 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.278161 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.278273 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.278478 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.278569 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.278795 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.278886 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.279125 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.279216 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.279434 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.279609 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.279740 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.279924 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.280056 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.280233 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.280370 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.280555 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.280677 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.280875 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.280981 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.281203 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.281403 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.281530 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.281725 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.281844 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.282032 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.282153 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.282350 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.282476 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.282668 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.282798 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.282989 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.283134 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.283292 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.283448 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.283599 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.283753 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.283898 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.284074 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.284201 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.284395 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.284516 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.284707 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.284819 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.285029 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.285128 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.285416 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.285515 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.285717 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.285808 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.286015 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.286113 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.286315 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.286407 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.286633 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.286736 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.286947 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.287052 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.287268 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.287359 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.287578 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.287675 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.287887 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.287991 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.288197 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.288293 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.288492 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.288580 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.288808 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.288939 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.289111 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.289341 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.289473 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.289662 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.289787 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.289976 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.290344 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.290456 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.290566 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.290674 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.290792 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.290911 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.291325 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.291450 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.291572 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.291681 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.291834 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.291953 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.292145 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.292271 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.292464 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.292594 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.292772 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.292890 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.293094 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.293265 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.293389 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.293585 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.293704 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.293902 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.294019 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.294225 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.294352 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.294526 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.294622 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.294827 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.294917 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.295159 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.295261 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.295462 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.295552 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.295764 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.295861 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.296064 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.296162 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.296369 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.296468 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.296670 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.296783 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.296974 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.297619 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.297784 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.297932 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.298102 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.298252 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.298401 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.298575 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.298719 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.298869 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.299062 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.299199 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.299365 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.299511 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.299669 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.299822 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.299974 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.300128 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.300316 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.300441 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.300614 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.300749 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.300939 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.301053 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.301245 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.301358 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.301561 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.301657 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.301875 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.301964 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.302188 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.302279 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.302500 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.302589 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.302810 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.302909 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.303146 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.303237 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.303457 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.303548 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.303767 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.303865 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.304072 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.304161 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.304383 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.304471 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.304694 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.304792 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.305005 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.305100 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.305329 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.305548 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.305638 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.305879 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.305971 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.306196 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.306295 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.306775 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.306884 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.307111 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.307214 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.307423 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.307514 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.307736 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.307843 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.308044 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.308139 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.308350 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.308439 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.308658 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.308819 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.308967 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.309058 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.309292 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.309503 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.309592 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.309834 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.309926 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.310150 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.310241 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.310470 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.310572 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.310783 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.310881 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.311129 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.311222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.311445 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.311546 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.311758 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.311852 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.312069 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.312158 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.312379 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.312471 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.312757 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.313344 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.313572 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.313670 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.313887 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.313978 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.314197 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.314286 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.314506 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.314596 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.314822 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.314913 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.315158 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.315248 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.315468 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.315572 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.315775 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.315865 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.316086 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.316179 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.316397 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.316561 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.316718 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.316810 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.317050 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.317138 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.317367 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.317455 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.317679 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.317775 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.317989 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.318077 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.318296 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.318385 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.318611 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.318808 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.318944 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.319151 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.319275 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.319482 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.319572 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.319805 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.319894 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.320131 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.320233 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.320444 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.320577 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.320759 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.320851 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.321084 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.321175 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.321387 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.321514 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.321691 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.321783 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.322000 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.322091 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.322306 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.322522 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.322611 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.322840 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.322992 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.323201 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.323292 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.323510 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.323597 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.323825 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.323960 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.324130 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.324220 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.324446 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.324655 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.324755 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.324997 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.325089 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.325309 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.325405 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.325631 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.325729 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.325943 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.326032 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.326249 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.326337 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.326551 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.326647 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.326864 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.326971 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.327215 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.327308 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.327535 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.327633 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.327844 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.327942 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.328150 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.328403 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.328502 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.328758 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.328857 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.329062 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.329151 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.329366 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.329464 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.329665 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.329755 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.329976 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.330067 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.330276 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.330375 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.330598 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.330688 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.330898 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.331020 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.331219 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.331310 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.331518 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.331651 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.331822 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.331911 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.332124 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.332216 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.332424 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.332513 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.332725 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.332814 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.333023 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.333114 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.333324 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.333414 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.333620 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.333709 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.333922 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.334052 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.334221 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.334312 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.334527 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.334625 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.334830 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.334919 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.335177 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.335266 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.335476 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.335579 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.335787 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.335885 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.336084 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.336171 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.336384 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.336484 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.336686 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.336774 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.336991 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.337078 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.337294 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.337395 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.337603 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.337706 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.337903 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.337992 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.338216 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.338308 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.338535 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.338630 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.338866 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.339151 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.339255 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.339487 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.339577 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.339807 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.339897 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.340109 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.340205 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.340428 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.340518 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.340748 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.340851 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.341047 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.341150 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.341348 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.341438 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.341664 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.341752 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.341969 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.342059 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.342277 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.342374 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.342582 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.342830 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.342968 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.343194 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.343285 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.343498 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.343585 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.343802 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.343909 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.344133 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.344223 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.344437 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.344526 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.344739 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.344838 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.345044 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.345143 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.345349 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.345445 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.345654 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.345755 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.345958 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.346049 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.346264 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.346357 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.346577 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.346668 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.346887 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.346996 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.347220 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.347307 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.347528 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.347618 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.347837 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.347927 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.348141 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.348237 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.348447 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.348544 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.348748 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.348836 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.349052 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.349148 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.349359 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.349455 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.349664 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.349752 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.349977 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.350077 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.350277 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.350372 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.350641 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.350958 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.351079 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.351277 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.351369 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.351594 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.351683 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.351903 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.351999 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.352212 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.352304 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.352520 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.352617 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.352832 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.352932 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.353136 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.353226 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.353453 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.353547 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.353760 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.353851 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.354064 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.354151 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.354403 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.354727 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.354823 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.355072 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.355168 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.355377 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.355466 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.355678 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.355783 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.355979 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.356070 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.356284 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.356373 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.356599 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.356690 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.356905 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.356996 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.357203 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.357300 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.357503 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.357595 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.357806 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.357898 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.358105 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.358193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.358405 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.358496 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.358704 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.358815 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.359028 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.359154 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.359333 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.359465 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.360142 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.360286 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.360446 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.360598 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.360745 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.360932 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.361041 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.361235 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.361333 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.361544 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.361638 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.361852 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.361942 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.362164 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.362253 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.362465 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.362561 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.362763 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.362853 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.363085 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.363178 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.363384 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.363476 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.363692 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.363783 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.363998 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.364181 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.364305 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.364502 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.364612 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.364821 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.364918 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.365169 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.365268 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.365448 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.365537 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.365753 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.365847 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.366069 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.366169 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.366376 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.366472 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.366682 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.366779 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.367006 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.367100 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.367314 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.367447 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.367633 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.367736 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.367939 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.368028 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.368254 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.368376 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.368560 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.368674 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.368865 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.368973 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.369168 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.369274 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.369492 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.369599 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.369811 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.369908 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.370111 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.370207 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.370436 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.370534 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.370743 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.370838 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.371080 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.371182 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.371393 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.371499 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.371702 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.371808 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.372015 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.372110 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.372318 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.372414 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.372627 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.372722 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.372936 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.373041 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.373241 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.373339 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.373545 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.373642 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.373856 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.373962 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.374161 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.374266 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.374465 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.374562 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.374779 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.374975 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.375114 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.375287 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.375478 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.375567 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.375796 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.375905 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.376101 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.376191 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.376411 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.376499 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.376722 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.376814 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.377036 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.377128 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.377348 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.377445 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.377667 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.377759 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.377979 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.378068 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.378287 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.378375 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.378597 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.378689 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.378898 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.379065 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.379152 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 04:30:23.379248 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.379567 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.379880 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.380209 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.380537 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.380882 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.381207 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.381550 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.381880 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.382198 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.382513 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.382819 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:30:23.383087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 04:30:23.533711 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO dbcounter [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Registered counter for database nova_api Sep 09 04:30:23.536312 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO dbcounter [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Registered counter for database nova_api Sep 09 04:30:23.553785 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_db.sqlalchemy.engines [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106455) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.555720 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_db.sqlalchemy.engines [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.560923 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writer thread running {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:23.562426 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writer thread running {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:23.619365 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.context [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8c5defc-d373-4759-8757-637e47363151(cell1) {{(pid=106456) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 04:30:23.619545 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.context [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8c5defc-d373-4759-8757-637e47363151(cell1) {{(pid=106455) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 04:30:23.623205 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:30:23.623535 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_concurrency.lockutils [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106455) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:30:23.623683 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:30:23.624009 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_concurrency.lockutils [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106455) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:30:23.625789 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:30:23.626070 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_concurrency.lockutils [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106455) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:30:23.626517 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:30:23.626792 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_concurrency.lockutils [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106455) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:30:23.626974 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:30:23.627262 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_concurrency.lockutils [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106455) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:30:23.628953 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:30:23.629276 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_concurrency.lockutils [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106455) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:30:23.630968 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO dbcounter [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Registered counter for database nova_cell0 Sep 09 04:30:23.631300 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO dbcounter [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Registered counter for database nova_cell0 Sep 09 04:30:23.634977 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO dbcounter [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Registered counter for database nova_cell1 Sep 09 04:30:23.635267 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO dbcounter [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Registered counter for database nova_cell1 Sep 09 04:30:23.642525 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_db.sqlalchemy.engines [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.644969 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_db.sqlalchemy.engines [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.645891 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_db.sqlalchemy.engines [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106455) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.647097 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_db.sqlalchemy.engines [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106455) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.649687 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writer thread running {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:23.653000 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writer thread running {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:23.658220 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writer thread running {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:23.791480 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writer thread running {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:23.799935 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO dbcounter [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Registered counter for database nova_cell0 Sep 09 04:30:23.801712 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO dbcounter [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Registered counter for database nova_cell0 Sep 09 04:30:23.807232 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG oslo_db.sqlalchemy.engines [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106455) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.810693 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_db.sqlalchemy.engines [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:30:23.811985 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writer thread running {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:23.815953 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writer thread running {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:30:24.148141 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: WARNING keystonemiddleware.auth_token [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:30:24.152953 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: WARNING keystonemiddleware.auth_token [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:30:24.155490 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: WARNING keystonemiddleware.auth_token [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:30:24.160806 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: WARNING keystonemiddleware.auth_token [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:30:24.497310 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: WARNING keystonemiddleware.auth_token [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:30:24.503214 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: WARNING keystonemiddleware.auth_token [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:30:24.503547 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: WARNING keystonemiddleware.auth_token [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:30:24.508475 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d651bf79c0 pid: 106456 (default app) Sep 09 04:30:24.509424 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: WARNING keystonemiddleware.auth_token [None req-5e2b062f-e246-4716-a9af-555070a85f4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:30:24.510529 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:30:24.511745 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001777 Sep 09 04:30:24.512172 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Fri Sep 9 04:30:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:30:24.514777 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d651bf79c0 pid: 106455 (default app) Sep 09 04:31:45.519671 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:31:45.520652 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 09 04:31:45.521320 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:31:45.534209 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_api:SELECT=3 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:45.535302 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_cell1:SELECT=3 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:45.536452 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_cell0:SELECT=3 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:45.537539 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:46.405852 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-de10736a-89c7-4977-86a5-704dd4a402c6 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:31:46.439252 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-de10736a-89c7-4977-86a5-704dd4a402c6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910934 Sep 09 04:31:46.440254 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 04:31:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:31:49.056934 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:31:49.057943 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-e93ffb35-ea59-4dcd-9d26-2b8b3f824410 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Sep 09 04:31:49.058972 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:31:49.525671 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-973a9ca9-7b26-4b10-87a6-5f7d3d8b1036 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "swap": 0, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:49.572478 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-973a9ca9-7b26-4b10-87a6-5f7d3d8b1036 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.507225 Sep 09 04:31:49.572950 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:31:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 04:31:49.587298 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_api:SELECT=3 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:49.589100 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_cell1:SELECT=3 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:49.590309 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_cell0:SELECT=3 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:49.593335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:31:49.802370 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-966599f1-f9f6-40e6-99d0-0865fbf78205 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:49.870506 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-966599f1-f9f6-40e6-99d0-0865fbf78205 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288633 Sep 09 04:31:49.871114 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 04:31:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:31:52.473815 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-973a9ca9-7b26-4b10-87a6-5f7d3d8b1036 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:31:52.474837 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-973a9ca9-7b26-4b10-87a6-5f7d3d8b1036 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 09 04:31:52.475527 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:31:53.130404 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-8789b33b-4181-4600-acdd-8fbf3160a0ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:53.170583 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-8789b33b-4181-4600-acdd-8fbf3160a0ec admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688630 Sep 09 04:31:53.171498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:31:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 04:31:53.183778 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-a2289058-2bfd-466b-9395-637ec9c2f0a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:53.240170 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-a2289058-2bfd-466b-9395-637ec9c2f0a3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060430 Sep 09 04:31:53.251192 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 04:31:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:31:55.863173 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-8789b33b-4181-4600-acdd-8fbf3160a0ec admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:31:55.864193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-8789b33b-4181-4600-acdd-8fbf3160a0ec admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 09 04:31:55.864603 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:31:56.281836 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-d6dbdc69-3ab7-4419-a469-aaf6e026d1be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:56.301715 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-d6dbdc69-3ab7-4419-a469-aaf6e026d1be admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430141 Sep 09 04:31:56.302377 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:31:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:31:56.314804 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-7a40453f-afbb-4ba6-86dd-5ab7b2f4b2a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:56.343535 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-7a40453f-afbb-4ba6-86dd-5ab7b2f4b2a0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032418 Sep 09 04:31:56.344127 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 04:31:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:31:58.971505 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-d6dbdc69-3ab7-4419-a469-aaf6e026d1be admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:31:58.972537 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-d6dbdc69-3ab7-4419-a469-aaf6e026d1be admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 09 04:31:58.973221 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:31:59.394592 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-d1b8654a-2b30-4ae5-a18c-aa9f2cf398ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:59.414392 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-d1b8654a-2b30-4ae5-a18c-aa9f2cf398ca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435158 Sep 09 04:31:59.415855 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:31:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:31:59.427551 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-a4dd2902-f257-4fbd-803f-98cbec1c6ec9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:31:59.457414 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-a4dd2902-f257-4fbd-803f-98cbec1c6ec9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033448 Sep 09 04:31:59.458133 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 04:31:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:32:02.140234 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-d1b8654a-2b30-4ae5-a18c-aa9f2cf398ca admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:02.141552 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-d1b8654a-2b30-4ae5-a18c-aa9f2cf398ca admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Sep 09 04:32:02.142113 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:02.575141 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-97984296-c898-4779-8199-cc0e11b2309f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "id": "d4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:02.596048 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-97984296-c898-4779-8199-cc0e11b2309f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447759 Sep 09 04:32:02.596931 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:32:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:02.610015 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-a81d17cd-2b50-42d3-938c-7a782e74afb1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:02.636639 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-a81d17cd-2b50-42d3-938c-7a782e74afb1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030718 Sep 09 04:32:02.637485 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Sep 9 04:32:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:32:05.609294 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-97984296-c898-4779-8199-cc0e11b2309f admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:05.610582 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-97984296-c898-4779-8199-cc0e11b2309f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Sep 09 04:32:05.611171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:06.048539 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-e607d043-16bd-4404-9bb7-6373360f475c admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:06.075035 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-e607d043-16bd-4404-9bb7-6373360f475c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.457138 Sep 09 04:32:06.075654 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 04:32:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:08.955957 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-97984296-c898-4779-8199-cc0e11b2309f admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:08.956970 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-97984296-c898-4779-8199-cc0e11b2309f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 09 04:32:08.957441 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:09.356982 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-001b3bc1-0870-4dec-9584-81aca8db8c69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:09.376247 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-001b3bc1-0870-4dec-9584-81aca8db8c69 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.411952 Sep 09 04:32:09.376793 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:32:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:09.389524 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-deb8fa74-c77f-4ae6-80ed-2a2f77d1f468 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:09.415676 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-deb8fa74-c77f-4ae6-80ed-2a2f77d1f468 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030384 Sep 09 04:32:09.416242 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 04:32:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:32:12.006264 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-001b3bc1-0870-4dec-9584-81aca8db8c69 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:12.007314 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-001b3bc1-0870-4dec-9584-81aca8db8c69 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 09 04:32:12.007713 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:12.398314 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-6d113423-a875-4e72-9723-48d509414b2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "id": "2", "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:12.423149 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-6d113423-a875-4e72-9723-48d509414b2e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409133 Sep 09 04:32:12.424661 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:32:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:12.444452 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-013add3d-2eaf-4d1a-8223-a54b92847237 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:12.470235 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-013add3d-2eaf-4d1a-8223-a54b92847237 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031667 Sep 09 04:32:12.470864 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 04:32:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:32:15.138337 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-6d113423-a875-4e72-9723-48d509414b2e admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:15.139429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-6d113423-a875-4e72-9723-48d509414b2e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 09 04:32:15.139821 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:15.682259 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-bb04397d-14b2-4e21-8e17-5c1030bc8f31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "swap": 0, "id": "3"}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:15.716881 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-bb04397d-14b2-4e21-8e17-5c1030bc8f31 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.570014 Sep 09 04:32:15.718110 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:32:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 04:32:15.729801 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-20363b83-6c11-42c1-bb6b-6e9c862409d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:15.735587 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:15.774112 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-20363b83-6c11-42c1-bb6b-6e9c862409d0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047920 Sep 09 04:32:15.795046 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 04:32:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:32:18.469718 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-bb04397d-14b2-4e21-8e17-5c1030bc8f31 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:18.470727 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-bb04397d-14b2-4e21-8e17-5c1030bc8f31 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 09 04:32:18.471166 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:18.979763 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-38f41282-1b52-4309-8be0-ba8f9602a8ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:19.006339 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-38f41282-1b52-4309-8be0-ba8f9602a8ea admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.528884 Sep 09 04:32:19.006898 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:32:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:19.025745 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-031622aa-ffd7-4325-a7ac-e88fc12e547b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:19.057133 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-031622aa-ffd7-4325-a7ac-e88fc12e547b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036283 Sep 09 04:32:19.057974 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 04:32:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:32:21.724235 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-38f41282-1b52-4309-8be0-ba8f9602a8ea admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:21.725381 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-38f41282-1b52-4309-8be0-ba8f9602a8ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 09 04:32:21.727363 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:22.205699 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-9d2fbece-4b1c-417a-9f04-f3c428dbcf63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:22.215490 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:22.227948 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-9d2fbece-4b1c-417a-9f04-f3c428dbcf63 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.493729 Sep 09 04:32:22.229109 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Sep 9 04:32:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:22.241745 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-5a0c6ef3-3bc1-4ad9-b592-8f3a215f0bc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:22.272339 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-5a0c6ef3-3bc1-4ad9-b592-8f3a215f0bc6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035128 Sep 09 04:32:22.273243 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Sep 9 04:32:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:32:39.966162 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-9d2fbece-4b1c-417a-9f04-f3c428dbcf63 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:39.967239 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-9d2fbece-4b1c-417a-9f04-f3c428dbcf63 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 09 04:32:39.967648 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:32:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:39.978019 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:32:40.354444 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-c2b7ddb4-bc94-4d31-bc0c-3e5cde937af7 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:40.372290 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-c2b7ddb4-bc94-4d31-bc0c-3e5cde937af7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398760 Sep 09 04:32:40.372819 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 04:32:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:41.681132 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-9d2fbece-4b1c-417a-9f04-f3c428dbcf63 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:41.682440 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-9d2fbece-4b1c-417a-9f04-f3c428dbcf63 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 09 04:32:41.682841 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:42.207839 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-00901d91-a26e-4f5e-90ab-a6c24df63fab admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:42.213181 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.wsgi [None req-00901d91-a26e-4f5e-90ab-a6c24df63fab admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-00901d91-a26e-4f5e-90ab-a6c24df63fab admin admin] Request method failure captured: Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Accept: application/json Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Accept-Encoding: gzip, deflate Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Connection: keep-alive Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Content-Length: 0 Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Host: 10.222.0.20 Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Openstack-Api-Version: compute 2.92 Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Openstack-System-Scope: None Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: User-Agent: python-novaclient Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Auth-Token: gAAAAABjGsHpOjlq4HAOsITi35dgom8ftxAGumagaw1xMoY9_MVM-mJPJCQOdGepj79fsVOwCcN7xFqmBSzzfbb3564vItvsSkrZ5OaIKPWtKk38NiIZwnv2sy5qlhHIRYht7Ua_8uXNaf4_iTqWWbB1362NdIqspt9RD5hXzAYa4BjcNZUneCo Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Domain-Id: None Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Domain-Name: None Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Identity-Status: Confirmed Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Is-Admin-Project: True Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Domain-Id: default Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Domain-Name: Default Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Name: admin Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Role: reader,member,admin Sep 09 04:32:42.216429 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Roles: reader,member,admin Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a501f44f388545198539783ea38ef108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a501f44f388545198539783ea38ef108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}] Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant: admin Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant-Name: admin Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User: admin Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Domain-Id: default Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Domain-Name: Default Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Id: f2b9f22768104befbb8f56575b4c786b Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Name: admin Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: method: > Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: exception: Flavor 42 could not be found. Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: action_args: {'id': '42'} Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:32:42.218089 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:42.219026 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.220171 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-00901d91-a26e-4f5e-90ab-a6c24df63fab admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106455) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:32:42.221209 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-00901d91-a26e-4f5e-90ab-a6c24df63fab admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394070 Sep 09 04:32:42.221209 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 04:32:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:42.227857 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-be51e305-4309-498e-a57d-a432960a724e admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:42.250827 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-be51e305-4309-498e-a57d-a432960a724e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026780 Sep 09 04:32:42.251408 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 04:32:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:42.263149 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-908835fc-37f1-45e9-8e81-668285492637 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:42.284001 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-908835fc-37f1-45e9-8e81-668285492637 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026473 Sep 09 04:32:42.284537 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 04:32:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:42.294877 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-4cef7c97-6ab4-428c-9b55-36b2fc983fd9 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:42.305188 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.wsgi [None req-4cef7c97-6ab4-428c-9b55-36b2fc983fd9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-4cef7c97-6ab4-428c-9b55-36b2fc983fd9 admin admin] Request method failure captured: Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Accept: application/json Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Accept-Encoding: gzip, deflate Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Connection: keep-alive Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Content-Length: 0 Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Host: 10.222.0.20 Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Openstack-Api-Version: compute 2.92 Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Openstack-System-Scope: None Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: User-Agent: python-novaclient Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Auth-Token: gAAAAABjGsHpOjlq4HAOsITi35dgom8ftxAGumagaw1xMoY9_MVM-mJPJCQOdGepj79fsVOwCcN7xFqmBSzzfbb3564vItvsSkrZ5OaIKPWtKk38NiIZwnv2sy5qlhHIRYht7Ua_8uXNaf4_iTqWWbB1362NdIqspt9RD5hXzAYa4BjcNZUneCo Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Domain-Id: None Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Domain-Name: None Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Identity-Status: Confirmed Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Is-Admin-Project: True Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Domain-Id: default Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Domain-Name: Default Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Name: admin Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Role: reader,member,admin Sep 09 04:32:42.309335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Roles: reader,member,admin Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a501f44f388545198539783ea38ef108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a501f44f388545198539783ea38ef108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}] Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant: admin Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant-Name: admin Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User: admin Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Domain-Id: default Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Domain-Name: Default Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Id: f2b9f22768104befbb8f56575b4c786b Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Name: admin Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: method: > Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: exception: Flavor 42 could not be found. Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: action_args: {'id': '42'} Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:32:42.310829 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:42.312087 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:42.313613 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-4cef7c97-6ab4-428c-9b55-36b2fc983fd9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:32:42.314880 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-4cef7c97-6ab4-428c-9b55-36b2fc983fd9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.020353 Sep 09 04:32:42.314880 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 04:32:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:43.517711 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-908835fc-37f1-45e9-8e81-668285492637 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:43.518760 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-908835fc-37f1-45e9-8e81-668285492637 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 09 04:32:43.519204 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:44.032926 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-e37cb311-3860-4d53-8878-89e24eeac73a admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:44.037976 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.wsgi [None req-e37cb311-3860-4d53-8878-89e24eeac73a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-e37cb311-3860-4d53-8878-89e24eeac73a admin admin] Request method failure captured: Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Accept: application/json Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Accept-Encoding: gzip, deflate Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Connection: keep-alive Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Content-Length: 0 Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Host: 10.222.0.20 Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Openstack-Api-Version: compute 2.92 Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Openstack-System-Scope: None Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: User-Agent: python-novaclient Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Auth-Token: gAAAAABjGsHrJK6Jw-rNwJ-ZcpcOeoCQtI06c17R_rvKIa64GgZupJArkaY1bjONuNueJKpq0Dc0ie-eqp07BfKyGcyaHkAvDIwVzham2kv_KsH-kzzo-5AcN84JGS-yvc6Phrqdc0QpcG6kli66vO0FvR7a2TnXncfjtjjxNHRWP46HD4Tze5w Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Domain-Id: None Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Domain-Name: None Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Identity-Status: Confirmed Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Is-Admin-Project: True Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Domain-Id: default Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Domain-Name: Default Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Name: admin Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Role: reader,member,admin Sep 09 04:32:44.039498 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Roles: reader,member,admin Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a501f44f388545198539783ea38ef108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a501f44f388545198539783ea38ef108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}] Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant: admin Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant-Name: admin Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User: admin Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Domain-Id: default Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Domain-Name: Default Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Id: f2b9f22768104befbb8f56575b4c786b Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Name: admin Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: method: > Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: exception: Flavor 84 could not be found. Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: action_args: {'id': '84'} Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:32:44.041056 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:44.041945 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.043658 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-e37cb311-3860-4d53-8878-89e24eeac73a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:32:44.045092 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-e37cb311-3860-4d53-8878-89e24eeac73a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.383142 Sep 09 04:32:44.045092 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 04:32:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:44.051232 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-9de54a15-e3fc-4ddd-8f75-cd2571608639 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:44.066690 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-9de54a15-e3fc-4ddd-8f75-cd2571608639 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018998 Sep 09 04:32:44.067257 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 04:32:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:44.076468 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-cdabe695-8bd0-4f58-8504-155d2a179cdb admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:44.091621 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-cdabe695-8bd0-4f58-8504-155d2a179cdb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018605 Sep 09 04:32:44.092171 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 04:32:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:44.101357 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-8d2bab0f-6a7b-44f0-8806-7a8e573d4e64 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:44.106691 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.wsgi [None req-8d2bab0f-6a7b-44f0-8806-7a8e573d4e64 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-8d2bab0f-6a7b-44f0-8806-7a8e573d4e64 admin admin] Request method failure captured: Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Accept: application/json Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Accept-Encoding: gzip, deflate Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Connection: keep-alive Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Content-Length: 0 Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Host: 10.222.0.20 Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Openstack-Api-Version: compute 2.92 Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Openstack-System-Scope: None Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: User-Agent: python-novaclient Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Auth-Token: gAAAAABjGsHrJK6Jw-rNwJ-ZcpcOeoCQtI06c17R_rvKIa64GgZupJArkaY1bjONuNueJKpq0Dc0ie-eqp07BfKyGcyaHkAvDIwVzham2kv_KsH-kzzo-5AcN84JGS-yvc6Phrqdc0QpcG6kli66vO0FvR7a2TnXncfjtjjxNHRWP46HD4Tze5w Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Domain-Id: None Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Domain-Name: None Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Identity-Status: Confirmed Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Is-Admin-Project: True Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Domain-Id: default Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Domain-Name: Default Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Name: admin Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Role: reader,member,admin Sep 09 04:32:44.108222 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Roles: reader,member,admin Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a501f44f388545198539783ea38ef108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a501f44f388545198539783ea38ef108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}] Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant: admin Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant-Name: admin Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User: admin Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Domain-Id: default Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Domain-Name: Default Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Id: f2b9f22768104befbb8f56575b4c786b Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Name: admin Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: method: > Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: exception: Flavor 84 could not be found. Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: action_args: {'id': '84'} Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:32:44.109780 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:44.110804 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:44.112341 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-8d2bab0f-6a7b-44f0-8806-7a8e573d4e64 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106455) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:32:44.113630 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-8d2bab0f-6a7b-44f0-8806-7a8e573d4e64 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011620 Sep 09 04:32:44.113630 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Sep 9 04:32:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 04:32:45.329652 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-cdabe695-8bd0-4f58-8504-155d2a179cdb admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:45.330655 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-cdabe695-8bd0-4f58-8504-155d2a179cdb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 09 04:32:45.331118 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:45.858067 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-4610a59e-545c-4d47-a33f-7213ad533580 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:45.863835 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.wsgi [None req-4610a59e-545c-4d47-a33f-7213ad533580 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-4610a59e-545c-4d47-a33f-7213ad533580 admin admin] Request method failure captured: Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Accept: application/json Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Accept-Encoding: gzip, deflate Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Connection: keep-alive Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Content-Length: 0 Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Host: 10.222.0.20 Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Openstack-Api-Version: compute 2.92 Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Openstack-System-Scope: None Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: User-Agent: python-novaclient Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Auth-Token: gAAAAABjGsHteU83djblvNS5WpoZVriaXsuGAYeeduEi63qZUxmDdthfDDOmQhdpFWmkQCU2NXh3qNpnhOu1nZ3tnMEObNKGJTVOPMFufkdT6sPyXPx-W-CPWjTbEb-DE7C2ANm--9XwbFgRxTWu6GC7QEicSv6cmSlPOHgDaQRIYtsZn5yjOGQ Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Domain-Id: None Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Domain-Name: None Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Identity-Status: Confirmed Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Is-Admin-Project: True Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Domain-Id: default Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Domain-Name: Default Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Project-Name: admin Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Role: reader,member,admin Sep 09 04:32:45.865323 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Roles: reader,member,admin Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a501f44f388545198539783ea38ef108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a501f44f388545198539783ea38ef108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}] Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant: admin Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-Tenant-Name: admin Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User: admin Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Domain-Id: default Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Domain-Name: Default Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Id: f2b9f22768104befbb8f56575b4c786b Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: X-User-Name: admin Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: method: > Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: exception: Flavor 451 could not be found. Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: action_args: {'id': '451'} Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:32:45.866858 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:45.868995 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.870260 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-4610a59e-545c-4d47-a33f-7213ad533580 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106455) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:32:45.872179 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-4610a59e-545c-4d47-a33f-7213ad533580 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392072 Sep 09 04:32:45.872179 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 04:32:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:45.877133 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-157d6f0e-6639-4353-a08d-7f6296aa5b9b admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:45.891857 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-157d6f0e-6639-4353-a08d-7f6296aa5b9b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018253 Sep 09 04:32:45.892373 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 04:32:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:45.901402 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:45.916383 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018390 Sep 09 04:32:45.916906 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Sep 9 04:32:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:32:45.926605 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-48470174-4825-4c3e-924e-077c65435e07 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:45.931443 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.wsgi [None req-48470174-4825-4c3e-924e-077c65435e07 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-48470174-4825-4c3e-924e-077c65435e07 admin admin] Request method failure captured: Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Accept: application/json Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Accept-Encoding: gzip, deflate Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Connection: keep-alive Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Content-Length: 0 Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Host: 10.222.0.20 Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Openstack-Api-Version: compute 2.92 Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Openstack-System-Scope: None Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: User-Agent: python-novaclient Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Auth-Token: gAAAAABjGsHteU83djblvNS5WpoZVriaXsuGAYeeduEi63qZUxmDdthfDDOmQhdpFWmkQCU2NXh3qNpnhOu1nZ3tnMEObNKGJTVOPMFufkdT6sPyXPx-W-CPWjTbEb-DE7C2ANm--9XwbFgRxTWu6GC7QEicSv6cmSlPOHgDaQRIYtsZn5yjOGQ Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Domain-Id: None Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Domain-Name: None Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Identity-Status: Confirmed Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Is-Admin-Project: True Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Domain-Id: default Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Domain-Name: Default Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Project-Name: admin Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Role: reader,member,admin Sep 09 04:32:45.933193 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Roles: reader,member,admin Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a501f44f388545198539783ea38ef108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a501f44f388545198539783ea38ef108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a501f44f388545198539783ea38ef108"}]}] Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant: admin Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant-Id: a501f44f388545198539783ea38ef108 Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-Tenant-Name: admin Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User: admin Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Domain-Id: default Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Domain-Name: Default Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Id: f2b9f22768104befbb8f56575b4c786b Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: X-User-Name: admin Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: method: > Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: exception: Flavor 451 could not be found. Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: action_args: {'id': '451'} Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:32:45.934716 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:45.935715 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: ERROR nova.api.openstack.wsgi Sep 09 04:32:45.937088 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-48470174-4825-4c3e-924e-077c65435e07 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:32:45.938446 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-48470174-4825-4c3e-924e-077c65435e07 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011424 Sep 09 04:32:45.938446 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 04:32:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 04:32:47.169170 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:47.170180 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 09 04:32:47.170574 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:47.686499 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-6f968593-4add-4a14-8b8d-01e12181688f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:47.705171 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-6f968593-4add-4a14-8b8d-01e12181688f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398447 Sep 09 04:32:47.705706 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 04:32:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:48.941113 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:48.942139 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 09 04:32:48.942540 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:49.459349 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-711978e8-2570-4ae0-b015-610f2b0bdc47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:49.477750 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-711978e8-2570-4ae0-b015-610f2b0bdc47 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399377 Sep 09 04:32:49.478299 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 04:32:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:50.700686 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:50.701681 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 09 04:32:50.702073 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:51.226079 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-5b2dd66d-5fbc-4b88-b7a0-45fef0ebf3a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:51.246763 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-5b2dd66d-5fbc-4b88-b7a0-45fef0ebf3a7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406956 Sep 09 04:32:51.247335 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 04:32:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:32:52.452201 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:52.453204 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 09 04:32:52.453597 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:52.971010 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-c82e3b43-1ca1-47c2-8869-ec6098ef3446 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:32:52.989289 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-c82e3b43-1ca1-47c2-8869-ec6098ef3446 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401407 Sep 09 04:32:52.989827 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Sep 9 04:32:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 04:32:54.320962 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:54.322006 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 09 04:32:54.322401 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:32:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:32:54.840284 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-61a25d2d-7e7a-4598-be93-dbb930e38611 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:32:54.860224 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-61a25d2d-7e7a-4598-be93-dbb930e38611 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401291 Sep 09 04:32:54.860941 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Fri Sep 9 04:32:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:33:51.525091 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:33:51.526716 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-b74258f0-1735-4084-af66-fbbd662f8e53 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 09 04:33:51.527176 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Fri Sep 9 04:33:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:33:51.537836 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:51.915212 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-8d75bca6-ae68-40ba-8db7-a2622608a28e admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:33:51.936183 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-8d75bca6-ae68-40ba-8db7-a2622608a28e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402834 Sep 09 04:33:51.936722 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Sep 9 04:33:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:33:51.957611 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_api:SELECT=14 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:33:51.961304 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-ed25ee0e-dee8-4181-a6cc-9e0345cca129 admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:33:51.969363 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-ed25ee0e-dee8-4181-a6cc-9e0345cca129 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013261 Sep 09 04:33:51.969885 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Sep 9 04:33:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:33:51.982114 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-799e1f34-82ff-4d8f-80da-88d352bb74f2 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:33:51.989385 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-799e1f34-82ff-4d8f-80da-88d352bb74f2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011500 Sep 09 04:33:51.989892 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Sep 9 04:33:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:33:52.001096 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:33:52.008099 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010488 Sep 09 04:33:52.008621 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Sep 9 04:33:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:33:52.019521 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-c38f0ebf-1321-4d7e-a66e-aa3041d056ea admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:33:52.026848 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-c38f0ebf-1321-4d7e-a66e-aa3041d056ea admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010168 Sep 09 04:33:52.027391 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Sep 9 04:33:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:36:55.625975 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:36:55.627468 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Sep 09 04:36:55.628122 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:36:55.768411 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_api:SELECT=6 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:36:55.923631 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:36:55.928483 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:36:55.928957 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:36:55.929380 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:36:55.930094 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:36:55.930535 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:36:55.931540 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:36:55.963086 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-cd902cd1-8000-4c95-af17-425684b3d101 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.195929 Sep 09 04:36:55.963637 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 04:36:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:36:57.038440 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:36:57.039490 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 09 04:36:57.039890 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:36:57.229467 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:36:57.232875 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:36:57.233351 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:36:57.233778 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:36:57.234495 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:36:57.234953 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:36:57.235382 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:36:57.254964 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-176b8ff9-8eeb-4460-bcdc-8452e8083262 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076435 Sep 09 04:36:57.255490 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 04:36:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:37:08.770303 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:37:08.771365 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 09 04:37:08.771762 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:37:08.914968 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_cell0:SELECT=4 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:37:08.915690 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_cell1:SELECT=4 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:37:08.916304 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG dbcounter [-] [106456] Writing DB stats nova_api:SELECT=8 {{(pid=106456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:37:08.964272 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:37:08.967782 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:37:08.968293 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:37:08.968725 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:37:08.969442 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:37:08.969892 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:37:08.970311 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:37:08.994794 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-061d6b8e-75db-44da-868d-77c27e00b219 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084244 Sep 09 04:37:08.995308 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 04:37:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:37:10.077502 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG nova.api.openstack.wsgi [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] Calling method '>' {{(pid=106455) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:37:10.078921 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: INFO nova.api.openstack.requestlog [None req-09cfeaa8-ad91-436d-8ece-8c91cb4ced0b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 09 04:37:10.079445 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: [pid: 106455|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Sep 9 04:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:37:10.270322 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG nova.api.openstack.wsgi [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] Calling method '>' {{(pid=106456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:37:10.273758 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:37:10.274884 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:37:10.275331 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:37:10.276039 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:37:10.276480 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:37:10.276892 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: DEBUG oslo_concurrency.lockutils [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:37:10.297954 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: INFO nova.api.openstack.requestlog [None req-75c49a17-370a-446b-bdc1-0fd27865497d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079459 Sep 09 04:37:10.298433 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: [pid: 106456|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Sep 9 04:37:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:38:08.892873 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: Fri Sep 9 04:38:08 2022 - graceful shutdown triggered... Sep 09 04:38:08.893408 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: Gracefully killing worker 1 (pid: 106455)... Sep 09 04:38:08.893110 dv-cinder-856002-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 04:38:08.894243 dv-cinder-856002-3-iscsi devstack@n-api.service[106456]: Gracefully killing worker 2 (pid: 106456)... Sep 09 04:38:09.023079 dv-cinder-856002-3-iscsi devstack@n-api.service[106455]: DEBUG dbcounter [-] [106455] Writing DB stats nova_api:SELECT=4 {{(pid=106455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:09.894020 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: worker 1 buried after 1 seconds Sep 09 04:38:09.894605 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: worker 2 buried after 1 seconds Sep 09 04:38:09.894605 dv-cinder-856002-3-iscsi devstack@n-api.service[106450]: goodbye to uWSGI. Sep 09 04:38:09.895688 dv-cinder-856002-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 04:38:09.896238 dv-cinder-856002-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 04:38:09.899091 dv-cinder-856002-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 04:38:09.909112 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 04:38:09.911800 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 04:38:09 2022] *** Sep 09 04:38:09.911964 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: nodename: dv-cinder-856002-3-iscsi Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: machine: x86_64 Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: clock source: unix Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: pcre jit disabled Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: detected number of CPU cores: 4 Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: current working directory: / Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: detected binary path: /usr/bin/uwsgi-core Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: your processes number limit is 47680 Sep 09 04:38:09.912115 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: your memory page size is 4096 bytes Sep 09 04:38:09.912788 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: detected max file descriptor number: 2048 Sep 09 04:38:09.912788 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: lock engine: pthread robust mutexes Sep 09 04:38:09.912788 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: thunder lock: enabled Sep 09 04:38:09.912788 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 04:38:09.912788 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 04:38:09.953753 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: Python main interpreter initialized at 0x55cb7ac9c9c0 Sep 09 04:38:09.953753 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: python threads support enabled Sep 09 04:38:09.953753 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: your server socket listen backlog is limited to 100 connections Sep 09 04:38:09.953753 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: your mercy for graceful operations on workers is 90 seconds Sep 09 04:38:09.954235 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 04:38:09.954235 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: *** Operational MODE: preforking *** Sep 09 04:38:09.954505 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: *** uWSGI is running in multiple interpreter mode *** Sep 09 04:38:09.954505 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: spawned uWSGI master process (pid: 127416) Sep 09 04:38:09.954709 dv-cinder-856002-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 04:38:09.957505 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: spawned uWSGI worker 1 (pid: 127436, cores: 1) Sep 09 04:38:09.958970 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: spawned uWSGI worker 2 (pid: 127437, cores: 1) Sep 09 04:38:09.958970 dv-cinder-856002-3-iscsi devstack@n-api.service[127416]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 04:38:10.615464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 04:38:10.616076 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 04:38:11.803244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:38:11.803244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: from cryptography.utils import int_from_bytes Sep 09 04:38:11.804575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:38:11.804575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: from cryptography.utils import int_from_bytes Sep 09 04:38:11.996138 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:38:11.996138 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: from cryptography.utils import int_from_bytes Sep 09 04:38:11.996732 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 04:38:11.996732 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: from cryptography.utils import int_from_bytes Sep 09 04:38:14.279903 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 04:38:14.280485 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 04:38:14.280702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 04:38:14.281055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 04:38:14.281316 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 04:38:14.281703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.282028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.282351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.282671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.283026 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.283340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.283668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.283993 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.284321 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.284585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.284903 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.285382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-3-iscsi {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.285715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.286032 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.286351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.286676 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.287008 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.287340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.287653 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.288704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.289971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.289971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.290155 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.290548 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.290767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.291078 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.291392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.291703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.292021 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.292346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.292754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-3-iscsi {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.293079 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.293389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.293698 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.294128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.294435 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.294752 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.295099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.295423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.295734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.296060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.296387 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.296702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.297029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.297338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.297651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.297962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.298291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.298599 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.298909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.299186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.299499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.299826 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.300150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.300479 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.300732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.303381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.303381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.303381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.303381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.303381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.303381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.303381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.304604 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.304604 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.304604 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.304604 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.304867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.305176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.305504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.305813 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.306141 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.306546 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.306800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.307138 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.307484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.307808 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.308118 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.308450 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.308775 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.309085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.309397 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.310066 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.310066 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.310416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.310644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.311212 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.311694 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.312152 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.312647 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.313223 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.313540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.313853 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.314163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.314476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.314791 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.315128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.315444 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.315757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.316109 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.316373 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.316754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.316990 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.317300 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.317624 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.317948 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.318258 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.318583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.318880 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.319215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.319570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.319881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.320226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.320517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.320825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.321583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.321583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.321909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.322067 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.322354 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.322657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.322985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.323312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.323625 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.323933 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.324241 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.324549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.324857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.325165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.325471 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.325812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.326091 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.326403 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.326743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.327083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.327505 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.327679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.328000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.328345 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.328722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.329028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.329347 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.329685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.330018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.330341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.330658 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.331008 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.331345 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.331662 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.331978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.332296 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.332622 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.332947 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.333286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.333610 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.333935 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.334261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.334578 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.335434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.335778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.336112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.336500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.336780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.337212 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.337445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.337780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.338114 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.338433 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.338751 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.339098 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.339442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.339825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.340079 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.340403 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.340722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.341051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.341369 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.341684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.342000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.342317 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.342632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.343002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.343323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.344120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.344120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.344473 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.344703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.344891 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.345209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.345528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.345837 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.346147 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.346458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.346770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.347097 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.347423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.347832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.348051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.348389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.348701 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.349070 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.349329 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.349644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.349967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.350269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.350649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.351490 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.351822 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.352137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.352448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.352780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.353061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 04:38:14.353685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.353878 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 04:38:14.354038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.354038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.354329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 04:38:14.354487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.354643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 04:38:14.354801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.354987 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 04:38:14.355156 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.355314 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.355461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.355607 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.355760 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.355930 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.356085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.356241 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.356395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.356543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.356845 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.357033 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.357260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.357580 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.357743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.358049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.358212 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.358376 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.358540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.358798 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.358982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.359168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.359424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.359579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-3-iscsi {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.359734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.359883 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.360056 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.360293 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.360455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.360653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.360816 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.360975 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.361133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.361282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.361440 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.361599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.361746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.361893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.362046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.362046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.362333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.362518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.362667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.362823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.363006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.365074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.366301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.366484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.366649 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.366823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.367183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.367437 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.367771 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.367771 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.368274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.368429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.368585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.368746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.368904 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.369075 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.369225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.369399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-3-iscsi {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.369655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.369809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.369966 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.370136 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.371029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.371206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.371365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.371365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.371671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.371829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.372381 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.372551 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.372709 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.372872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.373029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.373176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.373335 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.373489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.373636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.373794 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.373958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.374105 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.374251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.374406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.374553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.374715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.374877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.375052 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.375202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.375370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.375526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.375526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.375834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.375992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.376368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.376528 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.376674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.376834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.376995 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.377699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.377811 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.377900 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.377992 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.378088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.378166 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.378245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.378320 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.378414 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.378492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.378579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.378579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.378731 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.378827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.378915 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.379045 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.379133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.379221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.379314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.379400 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.379484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.379576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.379662 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.379747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.379821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.379904 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.379996 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.380150 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.380239 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.380323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.380407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.380490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.380582 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.380677 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.380771 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.380870 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.380957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.381901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.382016 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.382118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.382208 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.382300 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.382394 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.382481 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.382580 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.382675 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.382769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.382857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.382961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.383061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.383157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.383245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.383336 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.383429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.383516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.383600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.383696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.383784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.383876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.383970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.384065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.384160 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.384256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.384350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.384437 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.384521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.384611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.384711 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.384812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.384900 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.384985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.385076 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.385171 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.385266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.385266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.385420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.385420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.385582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.385582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.385761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.385856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.385949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.386036 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.386120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.386211 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.386305 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.386392 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.386483 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.386576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.386662 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.386754 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.386849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.386972 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.387073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.387168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.387254 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.387364 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.387474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.387570 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.387678 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.387767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.387866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.387962 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.388055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.388149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.388242 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.388335 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.388423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.388506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.388589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.388664 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.388735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.388814 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.388913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.389012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.389105 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.389200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.389286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.389370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.389461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.389555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.389555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.389721 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.389819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.389901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.389981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.390065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.390157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.390257 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.390351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.390445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.390532 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.390617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.390700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.390805 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.390899 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.391013 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.391098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.391179 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.391268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.391351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.391551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.391648 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.391769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.392076 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.392182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.392380 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.392475 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.392682 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.392778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.392985 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.393094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.393289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.393415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.393591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.393742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.393893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.394079 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.394179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.394411 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.394515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.394732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.394817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.395067 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.395166 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.395385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.395488 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.395696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.395791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.396004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.396097 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 04:38:14.396318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.396420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.396628 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.396722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.396938 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.397039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.397247 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.397874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.398087 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.398181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.398396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.398491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.398719 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.398822 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.399036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.399178 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.399352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.399472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.399671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.399772 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.399981 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.400128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.400297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.400390 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.400604 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.400697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.400919 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.401020 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.401229 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.401398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.401635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.401747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.401836 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.401928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.402144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.402247 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.402963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403078 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403330 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.403961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.404068 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.404148 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.404237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.404506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.404611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.404789 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.404882 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.405073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.405176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.405361 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.405465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.405845 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.405954 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.406042 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.406119 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.406227 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.406394 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.406534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.406710 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.406850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.407090 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.407397 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.407500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.407711 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.407888 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.408029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.408339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.408443 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.408672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.408937 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.409057 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.409222 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.409329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.409541 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.409636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.409865 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.409974 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.410173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.410263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.410482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.410581 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.410794 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.410902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.411136 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.411264 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.411451 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.411585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.411859 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.411971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.412081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.412327 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.412415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.412490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.412697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.412808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.413612 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.413728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.413934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.414026 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.414239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.414343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.414544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.414639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.414854 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.414966 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.415185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.415286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.415505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.415602 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.415822 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.415922 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.416127 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.416218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.416433 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.416526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.416748 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.416850 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.417054 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.417154 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.417362 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.417462 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.417671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.417770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.417978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.418079 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.418292 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.418392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.418599 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.418699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.418984 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.419086 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.419238 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.419366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.419549 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.419663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.419856 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.419964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.420168 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.420280 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.420474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.420592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.420776 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.420872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.421083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.421194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.421390 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.421497 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.421696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.421791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.422010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.422133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.422324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.422436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.422628 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.422720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.422953 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.423050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.423266 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.423372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.423596 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.423695 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.423915 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.424020 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.424223 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.424321 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.424548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.424649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.424873 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.424970 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.425189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.425271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.425494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.425575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.425803 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.425916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.426108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.426201 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.426412 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.426512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.426717 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.426853 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.427062 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.427178 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.427366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.427475 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.427671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.427755 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.427974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.428064 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.428276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.428419 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.428571 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.428730 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.428920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.429053 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.429352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.429504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.429661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.429802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.429949 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.430098 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.430237 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.430376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.430523 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.430672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.430820 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.431129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.431232 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.431331 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.431426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.431511 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.431709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.431814 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.432027 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.432149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.432334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.432423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.432650 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.432760 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.432958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.433063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.433272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.433374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.433580 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.433672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.433890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.434041 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.434200 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.434292 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.434509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.434611 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.434826 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.434917 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.435165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.435256 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.435477 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.435569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.435787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.435881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.436310 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.436423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.436423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.436587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.436688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.436785 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.437031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.437133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.437366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.437468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.437684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.437778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.438263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.438362 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.438580 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.438675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.438895 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.439088 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.439234 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.439362 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.439550 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.439727 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.439876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.440025 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.440166 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.440303 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.440463 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.440613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.440761 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.440904 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.441405 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.441553 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.441696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.441925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.442088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.442252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.442390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.442477 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.442657 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.442874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.443052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.443192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.443342 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.443481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.443629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.443786 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.443926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.444072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.444212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.444376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.444531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.444677 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.444826 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.444973 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445715 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.445995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.446275 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.446416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.446554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.446692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.446829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447015 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447108 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447195 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447547 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447760 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.447862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.448069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.448170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.448374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.448481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.448683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.448777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.448991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.449092 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.449318 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.449448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.449680 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.449807 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.449946 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.450045 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.450268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.450376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.450572 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.450667 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.450874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.450998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.451239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.451416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.451579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.451739 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.451885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.452027 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.452168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.452323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.452468 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.452616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.452767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.452905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.453054 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.453207 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.453345 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.453500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.453660 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.453812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.453978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.454125 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.454286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.454455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.454599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.454766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.454908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.455104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.455237 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.455412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.455562 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.455725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.455874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.456036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.456180 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.456345 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.456485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.456737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.456846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.457050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.457146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.457378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.457470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.457695 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.457787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.458000 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.458090 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.458308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.458408 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.458624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.458726 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.458945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.459041 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.459271 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.459429 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.459575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.459719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.460398 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.460669 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.460770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.461002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.461109 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.461318 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.461419 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.461637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.461732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.461977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.462385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.462385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.462553 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.462649 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.462778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.462925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.463040 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.463294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.463395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.463619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.463714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.463929 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.464022 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.464238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.464341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.464545 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.464647 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.464855 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.464949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.465161 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.465260 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.465463 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.465563 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.465768 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.465863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.466074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.466176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.466377 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.466467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.466681 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.466784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.467008 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.467124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.467313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.467404 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.467619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.467709 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.467919 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.468027 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.468229 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.468330 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.468534 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.468635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.468851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.468951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.469163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.469265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.469464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.469557 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.469759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.469855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.470064 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.470197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.470408 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.470506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.470715 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.470814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.471059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.471153 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.471391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.471504 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.471714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.471815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.472023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.472121 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.472332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.472477 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.472650 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.472745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.472952 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.473044 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.473258 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.473366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.473562 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.473655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.473872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.473979 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.474180 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.474282 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.474485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.474587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.474796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.474896 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.475135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.475364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.475458 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.476253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.476381 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.476573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.476694 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.476890 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.476996 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.477204 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.477300 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.477524 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.477630 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.477833 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.477934 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.478141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.478234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.478445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.478560 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.478755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.478850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.479088 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.479194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.479392 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.479514 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.479702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.479827 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.480013 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.480126 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.480317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.480441 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.480622 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.480721 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.480923 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.481021 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.481229 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.481326 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.481555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.481659 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.481845 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.481951 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.482150 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.482267 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.482481 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.482620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.482791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.482900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.483382 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.483492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.483583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.483683 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.483780 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.483868 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.484005 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.484131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.484311 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.484430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.484620 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.484734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.484942 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.485048 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.485258 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.485364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.485563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.485666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.485872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.485977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.486177 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.486288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.486480 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.486586 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.486785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.486880 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.487118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.487225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.487421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.487517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.487726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.487822 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.488029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.488332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.488434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.488636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.488741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.488959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.489056 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.489272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.489382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.489577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.489672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.489884 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.490001 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.490191 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.490314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.490535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.490630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.490843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.490968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.491225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.491322 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.491544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.491635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.491849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.491942 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.492156 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.492250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.492469 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.492577 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.492809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.492932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.493092 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.493212 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.493395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.493500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.493708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.493801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.494019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.494241 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.494387 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.494596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.494699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.494914 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.495026 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.495269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.495387 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.495603 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.495707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.495925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.496019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.496238 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.496341 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.496566 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.496668 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.496878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.496973 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.497188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.497296 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.497509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.497612 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.497817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.497916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.498125 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.498231 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.498433 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.498526 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.498744 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.498835 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.499305 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.499425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.499515 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.499601 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.499703 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.499797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.499973 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.500134 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.500314 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.500462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.500579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.500673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.500888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.500984 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.501195 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.501295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.501496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.501587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.501812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.501905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.502118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.502208 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.502420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.502521 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.502729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.502843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.503067 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.503173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.503378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.503486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.503682 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.503778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.504077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.504203 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.504396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.504521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.504705 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.504808 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.505008 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.505104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.505317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.505424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.505627 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.505725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.505941 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.506039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.506251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.506355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.506550 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.506643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.506897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.507037 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.507250 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.507361 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.507569 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.507673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.507887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.507993 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.508200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.508302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.508504 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.508601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.508816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.509072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.509186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.509414 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.509510 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.509728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.509823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.510144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.510272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.510389 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.510476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.510646 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.510777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.510989 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.511107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.511307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.511401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.511635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.511737 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.511950 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.512052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.512311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.512413 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.512583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.512685 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.512905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.513333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.513444 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.513577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.513670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.513756 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.513857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.513946 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.514112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.514215 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.514425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.514533 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.514740 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.514834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.515078 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.515187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.515395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.515503 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.515709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.515811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.516023 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.516124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.516329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.516430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.516655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.516750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.516980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.517074 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.517292 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.517396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.517609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.517702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.517932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.518027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.518247 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.518341 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.518562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.518663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.518876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.519309 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.519436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.519541 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.519631 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.519717 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.519845 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.519950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.520188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.520335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.520483 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.520636 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.520772 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.520942 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.521097 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.521199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.521401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.521495 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.521712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.521815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.522023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.522134 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.522332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.522982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.523185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.523301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.523488 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.523592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.523814 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.523919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.524118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.524228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.524441 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.524536 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.524758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.524860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.525083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.525185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.525404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.525498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.525709 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.525810 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.526038 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.526159 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.526351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.526457 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.526655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.526807 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.526984 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.527409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.527512 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.527601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.527601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.527766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.527894 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.528210 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.528322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.528417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.528504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.528652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.528799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.528896 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.529108 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.529211 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.529416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.529525 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.529730 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.529831 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.530039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.530134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.530380 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.530497 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.530656 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.530758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.530987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.531109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.531295 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.531393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.531597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.531688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.531906 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.531997 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.532207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.532307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.532513 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.532607 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.532816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.532909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.533120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.533235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.533424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.533529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.533725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.533861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.534027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.534130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.534348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.534442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.534652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.534754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.534995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.535094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.535305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.535398 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.535610 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.535716 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.535913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.536006 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.536214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.536317 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.536558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.536660 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.536862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.536962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.537188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.537291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.537496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.537600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.537810 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.537909 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.538666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.538777 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.539005 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.539114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.539324 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.539427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.539639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.539733 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.539958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.540064 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.540277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.540377 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.540595 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.540699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.540901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.541028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.541221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.541314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.541537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.541632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.541854 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.541949 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.542173 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.542372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.542509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.542706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.542809 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.543049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.543182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.543397 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.543620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.543755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.543879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.543994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.544114 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.544286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.544384 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.544603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.544706 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.544915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.545010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.545226 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.545338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.545538 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.545641 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.545865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.545966 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.546188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.546292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.546513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.546613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.546845 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.546961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.547188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.547291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.547506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.547607 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.547821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.547915 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.548136 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.548231 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.548490 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.548590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.548805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.548898 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.549250 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.549354 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.549442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.549528 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.549650 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 04:38:14.549759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.550029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.550342 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.550658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.550992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.551308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.551623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.551934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.552249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.552565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.552887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.553218 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.553539 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.553890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.554197 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.554513 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.555055 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.555371 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.555705 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.556032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.556358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.556672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.556990 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.557314 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.557620 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.557926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.558238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.558546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.558850 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.559201 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.559513 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.559817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.560136 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.560446 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.560977 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.561323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.561639 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.561965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.562293 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.562614 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.563192 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.563524 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.563888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.564132 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.564465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.564759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.565060 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.565362 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.565672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.565975 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.566278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.566585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.566886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.567251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.567559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.567862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.568165 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.568473 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.568778 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.569087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.569415 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.569719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.570029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.570331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.570637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.570961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.571271 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.571628 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.571939 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.572244 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.572565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.572867 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.573168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.573485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.573793 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.574117 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.574427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.574737 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.575115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.575432 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.575963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.576297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.576615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.576945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.577275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.577582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.577889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.578195 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.578517 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.578826 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.579165 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.579475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.579784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.580092 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.580401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.580708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.581018 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.581324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.581632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.581937 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.582245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.582551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.582858 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.583202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.583541 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.583860 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.584177 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.584491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.584807 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.585641 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.585949 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.586257 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.586567 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.586880 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.587236 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.587548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.587853 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.588531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.588849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.589176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.589497 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.589810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.590132 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.590454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.590766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.591280 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.591590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.591919 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.592255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.592584 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.592909 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.593213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.593517 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.593820 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.594128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.594447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.594753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.595089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.595392 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.595698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.596000 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.596302 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.596604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.596906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.597213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.597511 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.597814 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.598115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.598416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.598716 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.599043 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.599350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.599650 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.599952 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.600255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.601185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.601494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.601828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.602158 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.602473 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.602799 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.603135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.603461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.603770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.604091 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.604415 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.604728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.605304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.605417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.605657 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.605965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.606274 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.606582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.606888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.607219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.607543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.607865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.608170 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.608493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.608806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.609129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.609442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.609750 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.610284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.610448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.610686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.611017 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.611331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.611447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO dbcounter [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Registered counter for database nova_api Sep 09 04:38:14.611627 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.611938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.612247 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.612557 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.612872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.613186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.613514 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.613839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.614157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.614472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.614798 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.615161 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.615479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.615823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.616189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.616506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.616818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.617125 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 04:38:14.617366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 04:38:14.631447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_db.sqlalchemy.engines [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:14.638000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writer thread running {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:14.697162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.context [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8c5defc-d373-4759-8757-637e47363151(cell1) {{(pid=127436) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 04:38:14.701374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:38:14.701867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:38:14.703544 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:38:14.704339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:38:14.704792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:38:14.706869 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:38:14.709016 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO dbcounter [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Registered counter for database nova_cell0 Sep 09 04:38:14.713942 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO dbcounter [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Registered counter for database nova_cell1 Sep 09 04:38:14.721967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_db.sqlalchemy.engines [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:14.723407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_db.sqlalchemy.engines [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:14.730920 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writer thread running {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:14.732240 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writer thread running {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:14.769349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO dbcounter [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Registered counter for database nova_api Sep 09 04:38:14.790209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_db.sqlalchemy.engines [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:14.801719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writer thread running {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:14.867441 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.context [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c8c5defc-d373-4759-8757-637e47363151(cell1) {{(pid=127437) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 04:38:14.871010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:38:14.871501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:38:14.873094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:38:14.873868 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:38:14.874325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:38:14.876337 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:38:14.878361 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO dbcounter [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Registered counter for database nova_cell0 Sep 09 04:38:14.883069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO dbcounter [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Registered counter for database nova_cell1 Sep 09 04:38:14.886218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO dbcounter [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Registered counter for database nova_cell0 Sep 09 04:38:14.890453 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_db.sqlalchemy.engines [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:14.891755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_db.sqlalchemy.engines [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:14.894338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_db.sqlalchemy.engines [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:14.896555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writer thread running {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:14.899718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writer thread running {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:14.901216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writer thread running {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:15.046833 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO dbcounter [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Registered counter for database nova_cell0 Sep 09 04:38:15.054000 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_db.sqlalchemy.engines [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 04:38:15.059159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writer thread running {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 04:38:15.219192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: WARNING keystonemiddleware.auth_token [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:38:15.226435 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: WARNING keystonemiddleware.auth_token [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:38:15.379986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: WARNING keystonemiddleware.auth_token [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:38:15.388916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: WARNING keystonemiddleware.auth_token [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:38:15.569486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: WARNING keystonemiddleware.auth_token [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:38:15.575723 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: WARNING keystonemiddleware.auth_token [None req-aa795711-969c-407a-a82d-11c0d496e993 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:38:15.581559 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb7ac9c9c0 pid: 127436 (default app) Sep 09 04:38:15.734088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: WARNING keystonemiddleware.auth_token [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 04:38:15.740106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: WARNING keystonemiddleware.auth_token [None req-261cd4f7-e92d-4e5a-8872-2188894cdc73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 04:38:15.746034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb7ac9c9c0 pid: 127437 (default app) Sep 09 04:38:51.468524 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=3 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:51.470835 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=3 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:51.473458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=3 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:51.477317 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=3 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:53.367726 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b2acef69-bd2d-4926-99b2-2b255411e353 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Action: 'create', calling method: .version_select at 0x7f43fbd003a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1181326189", "metadata": {"Type": "work"}}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b2acef69-bd2d-4926-99b2-2b255411e353 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Request method failure captured: Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 122 Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNbFsn-VxhQooEP9nfNoh8dKdior_IsQw8GJR1lyd_vzRaWhcdK4ITcRvmjAfDDvrdsPMezYFDndmRpfQP3T6346PgXg88wFNTm6ssdjDlwvN8XJy_ZVM_Nu9jCscQ7zZREinjAA9ZkhbPq1GDQWEC2ahesFY4BzKoD7owjauK5a7s Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:38:53.375426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}] Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 7169599dbb3e47f098cacbfe1ae5bfcc Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1181326189", "metadata": {"Type": "work"}}} Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: Sep 09 04:38:53.376864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1181326189', 'metadata': {'Type': 'work'}}}} Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise error Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:38:53.377717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 04:38:53.379127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 04:38:53.382693 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 04:38:53.382693 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.383971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b2acef69-bd2d-4926-99b2-2b255411e353 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:38:53.385843 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b2acef69-bd2d-4926-99b2-2b255411e353 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.937467 Sep 09 04:38:53.391271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 04:38:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1944 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:38:53.400250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:53.402577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:53.403352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:53.403812 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:38:53.687758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-08e9ef82-2871-4f6b-9392-00d9758fb85a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Action: 'create', calling method: .version_select at 0x7f43fbd70940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-329981776", "metadata": {"Type": "work"}}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-08e9ef82-2871-4f6b-9392-00d9758fb85a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Request method failure captured: Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 119 Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNbFsn-VxhQooEP9nfNoh8dKdior_IsQw8GJR1lyd_vzRaWhcdK4ITcRvmjAfDDvrdsPMezYFDndmRpfQP3T6346PgXg88wFNTm6ssdjDlwvN8XJy_ZVM_Nu9jCscQ7zZREinjAA9ZkhbPq1GDQWEC2ahesFY4BzKoD7owjauK5a7s Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:38:53.696152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}] Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 7169599dbb3e47f098cacbfe1ae5bfcc Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-329981776", "metadata": {"Type": "work"}}} Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: Sep 09 04:38:53.697742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-329981776', 'metadata': {'Type': 'work'}}}} Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise error Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi '0' Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:38:53.698683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 04:38:53.700233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 04:38:53.701535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 04:38:53.701535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.702641 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-08e9ef82-2871-4f6b-9392-00d9758fb85a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:38:53.703965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-08e9ef82-2871-4f6b-9392-00d9758fb85a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.311033 Sep 09 04:38:53.704986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 04:38:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 04:38:53.718065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-172b7316-88ae-4ab6-9f23-08182e15857a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Action: 'create', calling method: .version_select at 0x7f43fbd00f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1349561577", "metadata": {"Type": "work"}}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-172b7316-88ae-4ab6-9f23-08182e15857a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Request method failure captured: Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 119 Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNbFsn-VxhQooEP9nfNoh8dKdior_IsQw8GJR1lyd_vzRaWhcdK4ITcRvmjAfDDvrdsPMezYFDndmRpfQP3T6346PgXg88wFNTm6ssdjDlwvN8XJy_ZVM_Nu9jCscQ7zZREinjAA9ZkhbPq1GDQWEC2ahesFY4BzKoD7owjauK5a7s Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:38:53.723866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}] Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 7169599dbb3e47f098cacbfe1ae5bfcc Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1349561577", "metadata": {"Type": "work"}}} Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: Sep 09 04:38:53.725756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349561577', 'metadata': {'Type': 'work'}}}} Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise error Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi '' Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:38:53.726709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 04:38:53.728311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 04:38:53.731002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 04:38:53.731002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:53.732105 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-172b7316-88ae-4ab6-9f23-08182e15857a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:38:53.734406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-172b7316-88ae-4ab6-9f23-08182e15857a tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021523 Sep 09 04:38:53.735895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 04:38:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:38:53.750422 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-806118c2-304c-43d4-a063-f98be5b6dac7 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Calling method '.version_select at 0x7f43fbcd28b0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:38:54.835302 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-806118c2-304c-43d4-a063-f98be5b6dac7 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] HTTP exception thrown: Volume tempest-invalid-1293028049 could not be found. Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-806118c2-304c-43d4-a063-f98be5b6dac7 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Request method failure captured: Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1293028049 HTTP/1.1 Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNbFsn-VxhQooEP9nfNoh8dKdior_IsQw8GJR1lyd_vzRaWhcdK4ITcRvmjAfDDvrdsPMezYFDndmRpfQP3T6346PgXg88wFNTm6ssdjDlwvN8XJy_ZVM_Nu9jCscQ7zZREinjAA9ZkhbPq1GDQWEC2ahesFY4BzKoD7owjauK5a7s Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:38:54.841632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}] Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 7169599dbb3e47f098cacbfe1ae5bfcc Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Volume tempest-invalid-1293028049 could not be found. Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'tempest-invalid-1293028049'} Sep 09 04:38:54.843559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1293028049 could not be found. (HTTP 404) (Request-ID: req-f3604826-dea2-4590-b506-f02399be6da6) Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:54.844516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 04:38:54.845887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1293028049 could not be found. Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:38:54.847411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1293028049 could not be found. Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1293028049 could not be found. Sep 09 04:38:54.849714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:54.853153 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-806118c2-304c-43d4-a063-f98be5b6dac7 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Returning 404 to user: Volume tempest-invalid-1293028049 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:38:54.854584 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-806118c2-304c-43d4-a063-f98be5b6dac7 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1293028049" status: 404 len: 99 microversion: 2.1 time: 1.111622 Sep 09 04:38:54.856757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 04:38:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1293028049 => generated 99 bytes in 1115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 04:38:54.866799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5a6e7f87-9920-4139-b259-7d60a36a3bcc tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004727 Sep 09 04:38:54.871864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Sep 9 04:38:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 04:38:54.885908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9664baec-2485-49cf-8e06-9c6268736589 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010997 Sep 09 04:38:54.887135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1137 bytes} [Fri Sep 9 04:38:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 04:38:54.896066 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-11722711-29c2-45c5-8ec0-82f1d2cfb0ef tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Calling method '.version_select at 0x7f43fbbbd3a0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:38:55.582351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-11722711-29c2-45c5-8ec0-82f1d2cfb0ef tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] HTTP exception thrown: Volume b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 could not be found. Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-11722711-29c2-45c5-8ec0-82f1d2cfb0ef tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Request method failure captured: Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: DELETE /compute/v2.1/os-volumes/b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 HTTP/1.1 Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNbFsn-VxhQooEP9nfNoh8dKdior_IsQw8GJR1lyd_vzRaWhcdK4ITcRvmjAfDDvrdsPMezYFDndmRpfQP3T6346PgXg88wFNTm6ssdjDlwvN8XJy_ZVM_Nu9jCscQ7zZREinjAA9ZkhbPq1GDQWEC2ahesFY4BzKoD7owjauK5a7s Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:38:55.587919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}] Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 7169599dbb3e47f098cacbfe1ae5bfcc Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Volume b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 could not be found. Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1'} Sep 09 04:38:55.589298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 could not be found. (HTTP 404) (Request-ID: req-80d9bb44-3322-45c2-87e2-0ca2d43711ea) Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:55.590151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 04:38:55.591162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 could not be found. Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 04:38:55.592073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 could not be found. Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 could not be found. Sep 09 04:38:55.592989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.597199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-11722711-29c2-45c5-8ec0-82f1d2cfb0ef tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Returning 404 to user: Volume b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:38:55.598564 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-11722711-29c2-45c5-8ec0-82f1d2cfb0ef tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1" status: 404 len: 109 microversion: 2.1 time: 0.706517 Sep 09 04:38:55.606837 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:38:54 2022] DELETE /compute/v2.1/os-volumes/b2c23d9a-3a0e-4fbf-bfee-0a8a75ff82d1 => generated 109 bytes in 715 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:38:55.615425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5cb7185b-0f59-482a-ab69-46871c48bb33 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Calling method '.version_select at 0x7f43fbaf5940>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:38:55.677274 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-5cb7185b-0f59-482a-ab69-46871c48bb33 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] HTTP exception thrown: Volume 35f87b7b-3f22-4c4f-a5cb-8104ba695374 could not be found. Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5cb7185b-0f59-482a-ab69-46871c48bb33 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Request method failure captured: Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/os-volumes/35f87b7b-3f22-4c4f-a5cb-8104ba695374 HTTP/1.1 Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNbFsn-VxhQooEP9nfNoh8dKdior_IsQw8GJR1lyd_vzRaWhcdK4ITcRvmjAfDDvrdsPMezYFDndmRpfQP3T6346PgXg88wFNTm6ssdjDlwvN8XJy_ZVM_Nu9jCscQ7zZREinjAA9ZkhbPq1GDQWEC2ahesFY4BzKoD7owjauK5a7s Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:38:55.679994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb415f49dfd64fdc88c46543878c6e74"}]}] Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: bb415f49dfd64fdc88c46543878c6e74 Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesNegativeTest-1699890952 Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 7169599dbb3e47f098cacbfe1ae5bfcc Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesNegativeTest-1699890952-project Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Volume 35f87b7b-3f22-4c4f-a5cb-8104ba695374 could not be found. Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '35f87b7b-3f22-4c4f-a5cb-8104ba695374'} Sep 09 04:38:55.681024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35f87b7b-3f22-4c4f-a5cb-8104ba695374 could not be found. (HTTP 404) (Request-ID: req-23f66e64-22a0-41be-9f02-508518be0bce) Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:55.681729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:38:55.682866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35f87b7b-3f22-4c4f-a5cb-8104ba695374 could not be found. Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 04:38:55.683938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35f87b7b-3f22-4c4f-a5cb-8104ba695374 could not be found. Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35f87b7b-3f22-4c4f-a5cb-8104ba695374 could not be found. Sep 09 04:38:55.684965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:38:55.686711 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5cb7185b-0f59-482a-ab69-46871c48bb33 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] Returning 404 to user: Volume 35f87b7b-3f22-4c4f-a5cb-8104ba695374 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:38:55.686900 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5cb7185b-0f59-482a-ab69-46871c48bb33 tempest-VolumesNegativeTest-1699890952 tempest-VolumesNegativeTest-1699890952-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35f87b7b-3f22-4c4f-a5cb-8104ba695374" status: 404 len: 109 microversion: 2.1 time: 0.075203 Sep 09 04:38:55.687916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:38:55 2022] GET /compute/v2.1/os-volumes/35f87b7b-3f22-4c4f-a5cb-8104ba695374 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:39:03.148481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-215566512", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:03.358493 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] validate_networks() for [('1c260770-d4b1-4e02-bd09-9b1833989c1e', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:39:05.118482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:39:05.119118 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:39:05.120474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:39:05.120474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:39:05.120812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:39:05.185191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:05.185725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:05.186173 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:05.186951 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:05.187405 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:05.187827 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:05.329115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:39:05.351863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for user d3c29c23d7524adf9c5a3271224ac8d3 and project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:39:05.423207 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:39:05.426273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:39:05.600072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-acdd20b0-a6b1-49cd-9c58-959cb08d14c9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.667913 Sep 09 04:39:05.601195 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 5/9] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:39:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:39:05.615988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-37d35dc2-810a-427f-a13f-820ee962618d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:05.616864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-37d35dc2-810a-427f-a13f-820ee962618d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:06.001590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-37d35dc2-810a-427f-a13f-820ee962618d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:06.026721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-37d35dc2-810a-427f-a13f-820ee962618d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1221 microversion: 2.1 time: 0.416996 Sep 09 04:39:06.028013 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:05 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1221 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:06.176929 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1772605120", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:06.257315 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] validate_networks() for [('1c260770-d4b1-4e02-bd09-9b1833989c1e', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:39:07.394982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:39:07.397274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:39:07.397912 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:39:07.398690 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:39:07.399283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:39:07.419250 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:07.419753 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:07.420197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:07.420932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:07.421411 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:07.421829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:07.468373 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:39:07.475992 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for user d3c29c23d7524adf9c5a3271224ac8d3 and project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:39:07.511367 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:39:07.516774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:39:07.654652 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6cdafbac-22d5-40fb-be9a-a4e6edb3cbf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.482623 Sep 09 04:39:07.665344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 6/11] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:39:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:39:07.671717 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0a9d8efd-348d-4beb-9b18-634d36586714 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:07.672446 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0a9d8efd-348d-4beb-9b18-634d36586714 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:07.876802 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0a9d8efd-348d-4beb-9b18-634d36586714 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:07.888763 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0a9d8efd-348d-4beb-9b18-634d36586714 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1222 microversion: 2.1 time: 0.221295 Sep 09 04:39:07.891509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:07 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:08.916467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e969f2f6-2cd3-43ac-98b8-ab71b48b2544 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:08.923238 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e969f2f6-2cd3-43ac-98b8-ab71b48b2544 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:09.063208 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e969f2f6-2cd3-43ac-98b8-ab71b48b2544 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:09.105055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e969f2f6-2cd3-43ac-98b8-ab71b48b2544 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1222 microversion: 2.1 time: 0.194199 Sep 09 04:39:09.106145 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:08 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:10.132945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:10.133701 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:10.144358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:10.147681 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:10.149746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:10.150512 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:10.151010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:10.152165 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:10.539950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:10.569320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8b44592e-79e7-4ffa-b732-669613abf257 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1226 microversion: 2.1 time: 0.439033 Sep 09 04:39:10.572964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:10 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1226 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:11.006735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b07c8683-1699-47b1-adad-4aaac20ed594 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'create', calling method: .version_select at 0x7f43fb2088b0>, body: {"keypair": {"name": "tempest-keypair-845498393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkAufavIBMGJO3fOhS6OWFtA2vHH0LDttCe4TSiSEze6w+toR4fNX2SMP0in75FhhdzDXMNWy/elkPjpmbf5P5Zd1uDmj/qho3bX6e05pU/CN5GAaAD+weOu5+VAtQsAQ=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:11.076237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-b07c8683-1699-47b1-adad-4aaac20ed594 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:39:11.091230 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-b07c8683-1699-47b1-adad-4aaac20ed594 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for user befee01f638c4e7681b30c64acad6a6a and project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:39:11.175558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b07c8683-1699-47b1-adad-4aaac20ed594 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.885591 Sep 09 04:39:11.176670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 8/15] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Sep 9 04:39:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 887 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 04:39:11.595082 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:11.596518 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:11.610624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:11.615945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:11.620401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:11.633622 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:11.635955 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:11.637707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:12.347411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:12.386978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-55b773aa-01c8-43bf-8aec-7900db68c339 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1282 microversion: 2.1 time: 0.796979 Sep 09 04:39:12.397496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:11 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1282 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:12.726005 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-235584423", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "networks": [{"uuid": "b959c498-d69d-4f98-8a4e-4836fcd711fe"}]}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:12.881805 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] validate_networks() for [('b959c498-d69d-4f98-8a4e-4836fcd711fe', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:39:14.269912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-336e2a0e-06b2-4d39-a336-3b938e333fe7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'create', calling method: .version_select at 0x7f43fba605e0>, body: {"keypair": {"name": "tempest-keypair-646859934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIBOFEn5NxrthfuFU0JFZf/RwY8dlYI6sOJcC3U0hJQzB3EK9af/q2zXXqKKWpUp8ih8qOqusxyvJtsLwAQ09zNOUF2J84t70py8a5BwnZQfpmmuu4LbyX2b4ElE6WO0g=="}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:14.470333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-336e2a0e-06b2-4d39-a336-3b938e333fe7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:39:14.495732 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-336e2a0e-06b2-4d39-a336-3b938e333fe7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for user bf68e214fd4740be96f2d6c4325f6ee9 and project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:39:14.632735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-336e2a0e-06b2-4d39-a336-3b938e333fe7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.317768 Sep 09 04:39:14.633987 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 9/17] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:39:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:39:14.645057 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:14.647728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:14.666333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:14.668546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:14.674085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:14.675466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:14.676124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:14.676902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:14.973795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:14.991554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b7f52bf4-cdd6-4a1a-89c8-d472579dac34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1280 microversion: 2.1 time: 0.351202 Sep 09 04:39:14.996939 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:14 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:16.026340 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:16.030107 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:16.042488 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:16.046289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:16.048856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:16.054666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:16.055779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:16.065952 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:17.409956 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:39:17.410479 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:39:17.410858 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:39:17.412290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:39:17.412797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:39:17.438250 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:17.439475 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:17.440871 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:17.443352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:17.444771 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:17.447278 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:17.463664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=4 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:17.467552 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=4 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:17.522501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Getting quotas for project 8cc9340f30fa4e299fd096d27b9c7dbd. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:39:17.540181 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Getting quotas for user 161e111ce6384c0caadaa06d4bcffee2 and project 8cc9340f30fa4e299fd096d27b9c7dbd. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:39:17.601878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:39:17.612578 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:39:17.799264 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d555d635-982d-42fc-86c3-276415f3d0b3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.987595 Sep 09 04:39:17.813236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 9/19] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 6004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:39:17.826735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-93d10c40-9bd1-4c3f-ba6f-be0355e2d937 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:17.827754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-93d10c40-9bd1-4c3f-ba6f-be0355e2d937 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:17.847251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:17.860343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1e9d6c64-e5d3-4640-a2ff-666734df5732 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 1.847434 Sep 09 04:39:17.860955 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 11/20] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:16 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:18.073260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93d10c40-9bd1-4c3f-ba6f-be0355e2d937 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:18.082237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-93d10c40-9bd1-4c3f-ba6f-be0355e2d937 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1214 microversion: 2.1 time: 0.266492 Sep 09 04:39:18.090633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 10/21] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:17 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:18.893995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:18.898414 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:18.908784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:18.912259 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:18.913367 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:18.915853 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:18.917753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:18.919963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:19.113680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d8f18a94-53d6-448e-8f23-b79977d8efdf tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:19.114482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d8f18a94-53d6-448e-8f23-b79977d8efdf tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:19.796413 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d8f18a94-53d6-448e-8f23-b79977d8efdf tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:19.831278 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d8f18a94-53d6-448e-8f23-b79977d8efdf tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1214 microversion: 2.1 time: 0.707115 Sep 09 04:39:19.845149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:19 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1214 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:20.522767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:20.534286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c54f95ef-fbca-49d9-9b70-1f9a14bef344 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 1.649703 Sep 09 04:39:20.540271 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:18 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:20.862887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:20.863533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:20.873040 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:20.873535 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:20.885345 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:20.886177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:20.886661 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:20.887214 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:21.559856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:21.560821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:21.579680 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:21.582096 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:21.587027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:21.592057 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:21.592681 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:21.593475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:21.780405 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:21.803132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e515af1b-4d2a-4b49-8341-9a12e70f6ac7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1274 microversion: 2.1 time: 0.943879 Sep 09 04:39:21.835592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:20 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1274 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:22.634806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:22.647363 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-61caf679-b60f-4fc1-9d8c-48a54cdbc307 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 1.091637 Sep 09 04:39:22.649495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:21 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:22.841556 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:22.842360 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:22.854850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:22.856988 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:22.862028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:22.863601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:22.865670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:22.867409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:23.420670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-675854a3-f030-4bc5-a7e0-e4e145309ff8 req-3c4b2a42-cc72-40d7-bab2-95c3451b8371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc64fdf-1f32-4a6f-9194-af9ea4628027", "tag": "bc5dbac3-7cd6-4c6c-bd0e-b46429ecebfe"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:23.456838 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-675854a3-f030-4bc5-a7e0-e4e145309ff8 req-3c4b2a42-cc72-40d7-bab2-95c3451b8371 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:23.459275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-675854a3-f030-4bc5-a7e0-e4e145309ff8 req-3c4b2a42-cc72-40d7-bab2-95c3451b8371 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:23.459920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-675854a3-f030-4bc5-a7e0-e4e145309ff8 req-3c4b2a42-cc72-40d7-bab2-95c3451b8371 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:23.511999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-675854a3-f030-4bc5-a7e0-e4e145309ff8 req-3c4b2a42-cc72-40d7-bab2-95c3451b8371 service nova] Creating event network-changed:bc5dbac3-7cd6-4c6c-bd0e-b46429ecebfe for instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 on hv-cinder-85600 Sep 09 04:39:23.514811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-675854a3-f030-4bc5-a7e0-e4e145309ff8 req-3c4b2a42-cc72-40d7-bab2-95c3451b8371 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 04:39:23.515397 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-675854a3-f030-4bc5-a7e0-e4e145309ff8 req-3c4b2a42-cc72-40d7-bab2-95c3451b8371 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 04:39:23.517545 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:23.522454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:23.523418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:23.525797 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:23.526706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:23.528475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:23.550866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.compute.rpcapi [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 04:39:23.553565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] Releasing lock "compute-rpcapi-router" {{(pid=127437) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 04:39:23.591161 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-12a70828-203e-4e7c-a1f6-2539aae6511a None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299298 Sep 09 04:39:23.591161 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:39:23.658758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:23.670529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a7f776cd-c3ba-40d3-9bac-6adea8c857c9 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1272 microversion: 2.1 time: 0.832156 Sep 09 04:39:23.673596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:22 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1272 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:23.674558 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:23.675380 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:23.705963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:23.706887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:23.707587 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:23.708862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:23.712017 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:23.712763 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:24.533486 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=8 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:24.687015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-bff4287f-09f9-4f5b-910b-efc21d77b683 req-25648b69-0750-4965-b9b8-ab412cb8a22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b22e86-a3f6-4e3d-bb20-2ef261176f1f", "tag": "a018459f-533b-4aed-aa62-2552577cedef"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:24.720529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bff4287f-09f9-4f5b-910b-efc21d77b683 req-25648b69-0750-4965-b9b8-ab412cb8a22f service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:24.723106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bff4287f-09f9-4f5b-910b-efc21d77b683 req-25648b69-0750-4965-b9b8-ab412cb8a22f service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:24.723745 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bff4287f-09f9-4f5b-910b-efc21d77b683 req-25648b69-0750-4965-b9b8-ab412cb8a22f service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:24.793404 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-bff4287f-09f9-4f5b-910b-efc21d77b683 req-25648b69-0750-4965-b9b8-ab412cb8a22f service nova] Creating event network-changed:a018459f-533b-4aed-aa62-2552577cedef for instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f on hv-cinder-85600 Sep 09 04:39:24.796119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bff4287f-09f9-4f5b-910b-efc21d77b683 req-25648b69-0750-4965-b9b8-ab412cb8a22f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127436) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 04:39:24.796867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bff4287f-09f9-4f5b-910b-efc21d77b683 req-25648b69-0750-4965-b9b8-ab412cb8a22f service nova] Acquired lock "compute-rpcapi-router" {{(pid=127436) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 04:39:24.798514 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:24.800874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:24.803397 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:24.806391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:24.807866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:24.808472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:24.839189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.compute.rpcapi [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 04:39:24.842909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] Releasing lock "compute-rpcapi-router" {{(pid=127436) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 04:39:24.878668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-da08275c-3d89-444f-b6fa-b0fc99cac417 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311304 Sep 09 04:39:24.881774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:39:24.909165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:24.910028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:24.927170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:24.927972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:24.928928 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:24.929930 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:24.930616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:24.931283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:25.658397 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:25.679038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7b6fc683-32e5-4fde-a37c-09c80b0de670 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1272 microversion: 2.1 time: 0.791386 Sep 09 04:39:25.679971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:25.688496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-42abb362-fa33-4d2c-aa74-ba17e0599d40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 2.018721 Sep 09 04:39:25.699688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:23 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:25.699866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:24 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1272 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:25.713338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1502860943", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be4e0000-0b0b-4f80-80d3-91d027df1d63"}], "security_groups": [{"name": "tempest-securitygroup--1346454603"}], "key_name": "tempest-keypair-845498393", "user_data": "}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:26.317730 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] validate_networks() for [('be4e0000-0b0b-4f80-80d3-91d027df1d63', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:39:26.712817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:26.714069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:26.723950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:26.725368 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:26.727785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:26.728891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:26.731360 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:26.731970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:27.299851 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:27.315574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-19addc70-a5d5-4447-86ac-a6e63cabafa2 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.607710 Sep 09 04:39:27.316207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:26 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:27.325787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:27.328029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:27.341818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:27.342323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:27.342765 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:27.343515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:27.344216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:27.344826 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:27.611187 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:39:27.615966 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:27.619526 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:39:27.620272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:39:27.620696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:39:27.621121 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:39:27.634194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1e36d804-04b8-40d3-94b4-add3d3e1c136 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.316924 Sep 09 04:39:27.637611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:27.641877 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:27.642392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:27.643218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:27.643884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:27.644314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:27.665262 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 17/32] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:27 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:27.667834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:39:27.672484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for user befee01f638c4e7681b30c64acad6a6a and project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:39:27.675963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-518954843", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da245dda-2c01-4deb-aa23-3957c02d97c0"}], "security_groups": [{"name": "tempest-securitygroup--613627094"}], "key_name": "tempest-keypair-646859934", "user_data": "}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:27.686530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:39:27.690878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:39:27.743857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-09494dfb-10b6-49dd-bd76-bc2e96b23974 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.042912 Sep 09 04:39:27.751037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 16/33] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Sep 9 04:39:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 04:39:27.756315 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6f2e1c5c-e285-4912-8a95-66aaa7553ba8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:27.757147 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6f2e1c5c-e285-4912-8a95-66aaa7553ba8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:27.762577 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:27.884046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6f2e1c5c-e285-4912-8a95-66aaa7553ba8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:27.892074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6f2e1c5c-e285-4912-8a95-66aaa7553ba8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:27.893536 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6f2e1c5c-e285-4912-8a95-66aaa7553ba8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:27.894745 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6f2e1c5c-e285-4912-8a95-66aaa7553ba8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1281 microversion: 2.20 time: 0.142463 Sep 09 04:39:27.895321 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:27 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1281 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:27.922800 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] validate_networks() for [('da245dda-2c01-4deb-aa23-3957c02d97c0', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:39:28.346370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:28.347050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:28.357817 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:28.359418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:28.360037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:28.368443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:28.369322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:28.369928 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:28.549268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:28.562304 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-22df5254-be9a-43e4-9f5b-828567a39c9d tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.220761 Sep 09 04:39:28.563370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 18/35] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:28 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:28.671069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:28.671717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:28.677796 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:28.680834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:28.681292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:28.682675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:28.683177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:28.683613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:28.921351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:28.948444 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-bb453908-1dfe-4b20-83ca-942820ca3892 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.279882 Sep 09 04:39:28.950536 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:28 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:28.958918 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:28.960222 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:28.975741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:28.977333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:28.977333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:28.978712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:28.979611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:28.983534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:29.046222 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:39:29.047631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:39:29.049387 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:39:29.049938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:39:29.050573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:39:29.070665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:29.071300 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:29.071925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:29.072995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:29.073621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:29.074200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:29.110783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:39:29.110783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for user bf68e214fd4740be96f2d6c4325f6ee9 and project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:39:29.136213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:29.155433 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:29.159966 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:29.160613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:39:29.162120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-26bf4784-1c40-46c8-aa66-7f6e6c465067 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1285 microversion: 2.20 time: 0.209993 Sep 09 04:39:29.164661 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 20/37] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:28 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:29.165333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:39:29.283827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fb6d28ad-c99b-4f90-82aa-929bf1209078 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.615480 Sep 09 04:39:29.285561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 18/38] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:39:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:39:29.306398 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7fd6af6d-4d57-4660-bc8a-182370f4542b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:29.307202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7fd6af6d-4d57-4660-bc8a-182370f4542b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:29.380409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7fd6af6d-4d57-4660-bc8a-182370f4542b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:29.392652 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7fd6af6d-4d57-4660-bc8a-182370f4542b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1236 microversion: 2.1 time: 0.099902 Sep 09 04:39:29.393424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 21/39] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:29 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:29.589571 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:29.590288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:29.610507 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:29.643452 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:29.648201 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:29.648983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:29.649727 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:29.650214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:29.973007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:29.974402 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:29.986843 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:29.990310 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:29.991186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:29.993834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:29.996112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:29.996822 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:30.104087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:30.114024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-875b0a3c-259b-446b-b053-2b44e9fc8b61 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.529112 Sep 09 04:39:30.133391 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:29 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:30.190950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:30.191590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:30.202438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:30.203216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:30.203900 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:30.205099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:30.206254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:30.207175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:30.218953 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:30.228381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1ba9c3d4-04f7-4f22-846e-7fd412915856 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.258539 Sep 09 04:39:30.229515 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:29 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:30.279028 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:30.287775 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:30.289609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:30.291087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f68df0f8-d8bd-4ce5-a23f-4b0906a807ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1285 microversion: 2.20 time: 0.105359 Sep 09 04:39:30.303183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 20/42] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:30 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:30.419301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:30.420142 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:30.426509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:30.427057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:30.427491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:30.428176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:30.428787 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:30.429205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:30.514864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:30.525128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9f090b06-403a-44ae-b259-d011106a0c68 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1240 microversion: 2.1 time: 0.109425 Sep 09 04:39:30.526477 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:30 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:31.142970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:31.143589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:31.149728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.150077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.150522 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.151221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.151674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.152094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.251655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:31.252351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:31.258609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.259405 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.260077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.260852 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.261363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.261845 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.355053 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:31.363726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3922316c-9076-415d-92e3-e03c4de44b58 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.224423 Sep 09 04:39:31.364976 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 21/44] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:31 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:31.369872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:31.370352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:31.388470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.388973 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.389416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.390122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.390740 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.391344 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.445261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:31.453684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3a48dd1d-16a6-46b8-bb50-1e51e7d276f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.205881 Sep 09 04:39:31.454263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 24/45] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:31 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:31.472063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:31.480917 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:31.482535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:31.483674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-85695fde-2d46-4aa9-a554-a42aa8bb9df4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1285 microversion: 2.20 time: 0.117548 Sep 09 04:39:31.484243 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:31 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:31.548249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:31.548856 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:31.555357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.555841 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.556279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.556970 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:31.557421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:31.557846 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:31.620751 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:31.630524 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-dbd7334a-0771-485e-8f28-b2f21a8d880d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1240 microversion: 2.1 time: 0.085956 Sep 09 04:39:31.631274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 25/47] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:31 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:32.386854 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:32.387584 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:32.394465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.395058 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.395545 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.396483 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.396946 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.397377 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.475633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:32.476371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:32.483094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.483592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.484011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.484705 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.485184 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.485601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.547345 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:32.556021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f2eda8fe-fe6b-4247-9280-f8f26f0ae8da tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.172894 Sep 09 04:39:32.556613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:32 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:32.562135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:32.562961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:32.571733 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.572226 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.572850 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.574368 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.575000 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.576213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.657247 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:32.666728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:32.668432 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:32.669764 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-524b71e2-4988-458e-9ed7-b4b80d25fc51 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1285 microversion: 2.20 time: 0.111742 Sep 09 04:39:32.670834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:32 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:32.675700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:32.676563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:32.684171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.684575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:32.685198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.685839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.687002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:32.688226 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:32.690109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:32.693349 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-87db6342-1fc0-4d83-af8d-1121efc13b7d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.221991 Sep 09 04:39:32.693929 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 26/50] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:32 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:32.711875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:32.756104 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:32.763828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b42cc563-dd5b-49b6-8eae-f94847299791 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1240 microversion: 2.1 time: 0.091702 Sep 09 04:39:32.764935 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 25/51] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:32 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:33.580026 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:33.581592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:33.592255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-ea7fc622-e813-497b-9ff1-b313540a8569 req-eb8309ea-08e8-4383-894a-428329ca4e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d", "tag": "0bd2a80e-3f55-4880-b053-2fd68ba4e2a3"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:33.600358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.600857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.601301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.602011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.602459 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.604797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.606789 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ea7fc622-e813-497b-9ff1-b313540a8569 req-eb8309ea-08e8-4383-894a-428329ca4e11 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.607318 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ea7fc622-e813-497b-9ff1-b313540a8569 req-eb8309ea-08e8-4383-894a-428329ca4e11 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.612033 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ea7fc622-e813-497b-9ff1-b313540a8569 req-eb8309ea-08e8-4383-894a-428329ca4e11 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.624515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-ea7fc622-e813-497b-9ff1-b313540a8569 req-eb8309ea-08e8-4383-894a-428329ca4e11 service nova] Creating event network-changed:0bd2a80e-3f55-4880-b053-2fd68ba4e2a3 for instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d on hv-cinder-85600 Sep 09 04:39:33.631061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-ea7fc622-e813-497b-9ff1-b313540a8569 req-eb8309ea-08e8-4383-894a-428329ca4e11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042301 Sep 09 04:39:33.632063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 26/52] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:39:33.703323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:33.704083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:33.714580 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.715121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.715547 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.716430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.716871 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.717290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.752906 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:33.764777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-12ead8c9-93ed-4509-a2bb-02b1dc32efc5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.188608 Sep 09 04:39:33.765989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 27/53] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:33 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:33.771386 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:33.772309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:33.778255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.782352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:33.787180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.787740 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.788502 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.788970 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.789577 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.792632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:33.794275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:33.795416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8c767779-db21-4347-929e-c439d12db272 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1277 microversion: 2.20 time: 0.097779 Sep 09 04:39:33.795968 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 27/54] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:33 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:33.802289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:33.803096 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:33.809067 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.809737 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.810316 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.811182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:33.811940 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:33.812504 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:33.900190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:33.908229 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-90b53261-6e6b-4811-bdd1-1123d7125520 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1232 microversion: 2.1 time: 0.111300 Sep 09 04:39:33.908871 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 28/55] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:33 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1232 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:33.955814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:33.963474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-73bdcaa0-6d54-4319-8ede-e1a0f445df72 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.196331 Sep 09 04:39:33.964205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 28/56] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:33 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:34.797068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:34.798556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:34.810068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:34.811390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:34.812098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:34.815855 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:34.816831 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:34.818689 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:34.829303 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:34.830107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:34.840523 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:34.842069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:34.842069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:34.843071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:34.843630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:34.844178 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:34.929986 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:34.938266 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:34.940271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:34.941430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-839338fb-c28b-4300-88e0-e45ec32b4f64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1277 microversion: 2.20 time: 0.124469 Sep 09 04:39:34.942007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 29/57] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:34 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:34.947398 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:34.948003 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:34.953938 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:34.954422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:34.954859 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:34.955791 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:34.956401 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:34.956977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:35.110392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:35.110392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-736370bb-d4da-47d9-a96f-7b72a8b3efcf tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1232 microversion: 2.1 time: 0.096520 Sep 09 04:39:35.110392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 30/58] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:34 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1232 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:35.110392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:35.110697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:35.110697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:35.110697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:35.110697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:35.110978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:35.110978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:35.111149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:35.111234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:35.111234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:35.111378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e7efba4f-136a-4a86-b087-5f51ed5c4dc4 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.274017 Sep 09 04:39:35.111378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:34 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:35.204382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:35.212048 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a7d66a1f-dad9-43ed-b9cd-4047a25d966f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.170330 Sep 09 04:39:35.212664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 31/60] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:35 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:35.974640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:35.974640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:35.974640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:35.978057 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:35.978704 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:35.979228 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:35.980256 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:35.980799 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:35.981402 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:36.047561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:36.059012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:36.061232 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:36.062676 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-83aa7ef5-f213-4025-8530-8787e470555e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1277 microversion: 2.20 time: 0.097855 Sep 09 04:39:36.063268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:35 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:36.127806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:36.128621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:36.131282 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:36.132215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:36.135226 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:36.135723 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:36.136163 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:36.136869 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:36.137477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:36.137906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:36.139861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:36.140426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:36.140965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:36.141860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:36.142576 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:36.143055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:36.245758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:36.253734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6ad4e21c-03f9-46b8-b28a-18de74e63199 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1232 microversion: 2.1 time: 0.130858 Sep 09 04:39:36.254706 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 32/62] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:36 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1232 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:36.265833 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:36.266601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:36.273204 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:36.273693 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:36.274129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:36.274825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:36.275318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:36.275743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:36.440778 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:36.450780 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0c8ee227-8ea3-41d4-997a-c9032dc5f3fd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.326849 Sep 09 04:39:36.454608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:36 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:36.486560 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:36.497468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-85243363-5900-470e-9d50-fcec521edabc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.241417 Sep 09 04:39:36.499174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 33/64] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:36 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:37.088513 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:37.089097 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:37.096068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.096569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.097039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.097972 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.099268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.099700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.177906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:37.186366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:37.187988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:37.189456 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5fda230a-c41b-4b20-9315-65d1ed4abe85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1277 microversion: 2.20 time: 0.105001 Sep 09 04:39:37.190217 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:37 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:37.277276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:37.277897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:37.284631 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.285119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.285569 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.286310 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.286766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.287237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.352219 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:37.359886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7bd42da4-f163-497d-8160-24e123938f8d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1232 microversion: 2.1 time: 0.086838 Sep 09 04:39:37.360448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:37 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1232 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:37.479478 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:37.483044 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:37.486440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.486923 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.487562 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.488269 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.488725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.489194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.524210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:37.524210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:37.531078 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.531570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.532006 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.532891 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:37.533350 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:37.533773 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:37.656970 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=6 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:37.828560 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:37.844794 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7ec28b81-91c5-4eeb-bdd6-1d745bde7525 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.326176 Sep 09 04:39:37.845712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:37 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:37.865842 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:37.886728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-afbaaa83-4f56-485f-826c-dce75cc91a4c tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.411684 Sep 09 04:39:37.888663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 33/68] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:37 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:38.216640 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:38.217468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:38.228591 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.231770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.233306 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:38.235865 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.238163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.239759 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:38.350673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:38.359729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:38.361257 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:38.362375 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5d476baa-6256-4d68-8744-ef37596914fe tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1333 microversion: 2.20 time: 0.150833 Sep 09 04:39:38.362949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 36/69] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:38 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1333 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:38.385937 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:38.386552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:38.392297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.393034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.393476 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:38.394378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.394720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.395263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:38.462066 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:38.470061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-823a8d7e-6133-4667-83ae-cae48e02bb55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1232 microversion: 2.1 time: 0.087922 Sep 09 04:39:38.471189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:38 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1232 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:38.871979 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:38.873940 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:38.881087 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.881872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.882455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:38.883308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.884006 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.884671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:38.913627 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:38.914236 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:38.925615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.926115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.926604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:38.927334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:38.927785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:38.928208 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:39.090123 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=4 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:39.142328 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=6 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:39.385934 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:39.389909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=38 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:39.399613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c6235b4e-1467-4376-9dde-f090c98946f1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.534044 Sep 09 04:39:39.401541 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 37/71] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:38 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:39.415770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:39.418733 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:39.419724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:39.430702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:39.433766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:39.436667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-78e42fd0-9bf7-4edb-84b4-9471fe7126a3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.527802 Sep 09 04:39:39.437239 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:39.438294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:39.438494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 35/72] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:38 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:39.440068 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:39.440515 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:39.497073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:39.497073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:39.505978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:39.506287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:39.506719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:39.507445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:39.513575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:39.514027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:39.592322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:39.601427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:39.602545 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:39.603690 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7e89ee9c-d81e-40b2-9086-551696f7943d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1339 microversion: 2.20 time: 0.200465 Sep 09 04:39:39.610107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 38/73] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:39 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:39.695548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:39.704205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4a13228a-b2ed-4660-944b-53d1fb74347d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1288 microversion: 2.1 time: 0.212247 Sep 09 04:39:39.708096 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 36/74] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:39 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1288 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:40.424994 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:40.425596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:40.433680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.434178 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.434615 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:40.435352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.435804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.436229 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:40.464998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:40.465601 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:40.474509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.476427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.478357 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:40.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.481149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.481776 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:40.824404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:40.828876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:40.855139 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-edad244f-0660-4c7f-96d8-59f1f6717fcb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.433639 Sep 09 04:39:40.855313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-85e3116f-fff7-4145-8c85-ed15f324465b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.393010 Sep 09 04:39:40.858570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 39/75] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:40 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:40.859241 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 37/76] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:40 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:40.868480 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:40.869309 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:40.875816 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:40.876817 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:40.891560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.893162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.894471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.895146 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.896508 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:40.896965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:40.897859 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.898774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:40.899417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.900131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:40.901526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:40.901859 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:41.515606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:41.525121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2d992903-e24b-4683-a5c9-b1bc17229e88 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1294 microversion: 2.1 time: 0.663532 Sep 09 04:39:41.532196 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 38/77] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:40 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1294 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:41.694220 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:41.709237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:41.713370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:41.718507 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2ee3e3ae-4805-4d37-a0bf-2782ce07771a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.855646 Sep 09 04:39:41.720385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 40/78] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:40 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:41.877697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-cdba8d1b-454b-4269-b652-7bd463fc1ddf req-c7e13047-64c3-4f98-9546-c3b0eb5cd0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc64fdf-1f32-4a6f-9194-af9ea4628027", "name": "network-vif-plugged", "status": "completed", "tag": "bc5dbac3-7cd6-4c6c-bd0e-b46429ecebfe"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:41.884329 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:41.885197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:41.895359 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:41.896039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:41.897338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-cdba8d1b-454b-4269-b652-7bd463fc1ddf req-c7e13047-64c3-4f98-9546-c3b0eb5cd0c6 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:41.897818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-cdba8d1b-454b-4269-b652-7bd463fc1ddf req-c7e13047-64c3-4f98-9546-c3b0eb5cd0c6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:41.898237 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-cdba8d1b-454b-4269-b652-7bd463fc1ddf req-c7e13047-64c3-4f98-9546-c3b0eb5cd0c6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:41.898511 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:41.902185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:41.902901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:41.903546 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:41.929454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-cdba8d1b-454b-4269-b652-7bd463fc1ddf req-c7e13047-64c3-4f98-9546-c3b0eb5cd0c6 service nova] Creating event network-vif-plugged:bc5dbac3-7cd6-4c6c-bd0e-b46429ecebfe for instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 on hv-cinder-85600 Sep 09 04:39:41.954201 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-cdba8d1b-454b-4269-b652-7bd463fc1ddf req-c7e13047-64c3-4f98-9546-c3b0eb5cd0c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418006 Sep 09 04:39:41.959605 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 39/79] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:39:41.966442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:41.967712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:41.989823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:41.990811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:41.991467 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:41.992338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:41.993066 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:41.994279 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:42.391890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:42.404940 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4df35ffb-b1c0-49f9-adcd-abe67bed3ebf tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.444006 Sep 09 04:39:42.411556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 40/80] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:41 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:42.446309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:42.454191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7e3cb5a1-34ba-4ff9-a19a-314e69b5c204 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.573566 Sep 09 04:39:42.458182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 41/81] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:41 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:42.557918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:42.562172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:42.588638 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:42.589703 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:42.591097 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:42.592128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:42.592752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:42.597898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:42.750784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:42.756029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:42.767110 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:42.767624 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:42.768072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:42.768792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:42.769251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:42.769683 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:43.152528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:43.166735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:43.168304 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:43.169774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:43.170974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1308c103-b05c-4bf6-a74b-04c74f9822f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.428821 Sep 09 04:39:43.171704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 42/82] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:42 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:43.196859 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a9c418b0-720b-49a1-92c1-43cedf661ccc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.643552 Sep 09 04:39:43.197472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 41/83] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:42 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:43.434053 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:43.434841 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:43.438035 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-d3c31b08-5542-4d0d-99cb-d4dbcf09eec7 req-a4b992e8-df15-48c7-a5f0-dd4d70188e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e", "tag": "4024da04-efc2-4a91-b9ed-e97cc0ac1f78"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:43.449887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:43.450395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:43.450837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:43.458519 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:43.459413 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:43.460033 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:43.463712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d3c31b08-5542-4d0d-99cb-d4dbcf09eec7 req-a4b992e8-df15-48c7-a5f0-dd4d70188e1a service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:43.464200 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d3c31b08-5542-4d0d-99cb-d4dbcf09eec7 req-a4b992e8-df15-48c7-a5f0-dd4d70188e1a service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:43.464821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d3c31b08-5542-4d0d-99cb-d4dbcf09eec7 req-a4b992e8-df15-48c7-a5f0-dd4d70188e1a service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:43.480293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-d3c31b08-5542-4d0d-99cb-d4dbcf09eec7 req-a4b992e8-df15-48c7-a5f0-dd4d70188e1a service nova] Creating event network-changed:4024da04-efc2-4a91-b9ed-e97cc0ac1f78 for instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e on hv-cinder-85600 Sep 09 04:39:43.485330 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-d3c31b08-5542-4d0d-99cb-d4dbcf09eec7 req-a4b992e8-df15-48c7-a5f0-dd4d70188e1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070973 Sep 09 04:39:43.486551 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 43/84] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:39:43.494910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:43.495846 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:43.503387 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:43.503879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:43.504354 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:43.505068 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:43.505715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:43.506140 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:43.816898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:43.826775 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-55c5cd3f-e7dd-49c9-99fe-72f76d550675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.396562 Sep 09 04:39:43.843392 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 42/85] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:43 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:43.913617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:43.931355 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-14764d59-3d33-4659-b75a-6e6a6afd903f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.440444 Sep 09 04:39:43.933874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 44/86] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:43 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:43.984190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-4924cf97-20ce-4c61-b387-72fcf98bead7 req-54665c71-60d3-405f-8a13-adbc9a726b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b22e86-a3f6-4e3d-bb20-2ef261176f1f", "name": "network-vif-plugged", "status": "completed", "tag": "a018459f-533b-4aed-aa62-2552577cedef"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:43.997565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-4924cf97-20ce-4c61-b387-72fcf98bead7 req-54665c71-60d3-405f-8a13-adbc9a726b01 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:43.998261 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-4924cf97-20ce-4c61-b387-72fcf98bead7 req-54665c71-60d3-405f-8a13-adbc9a726b01 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:43.999252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-4924cf97-20ce-4c61-b387-72fcf98bead7 req-54665c71-60d3-405f-8a13-adbc9a726b01 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.016333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-4924cf97-20ce-4c61-b387-72fcf98bead7 req-54665c71-60d3-405f-8a13-adbc9a726b01 service nova] Creating event network-vif-plugged:a018459f-533b-4aed-aa62-2552577cedef for instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f on hv-cinder-85600 Sep 09 04:39:44.023366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-4924cf97-20ce-4c61-b387-72fcf98bead7 req-54665c71-60d3-405f-8a13-adbc9a726b01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043937 Sep 09 04:39:44.024553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 43/87] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:39:44.037130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-d0843002-928a-464d-b7b6-33e67a0094b2 req-b86e29b6-2180-4f54-b138-16229960d1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee805de-a9e3-4596-9b43-d7cdc17b9e96", "tag": "7f751c26-39f9-4ccf-bac7-cc25e0b849e4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:44.049532 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d0843002-928a-464d-b7b6-33e67a0094b2 req-b86e29b6-2180-4f54-b138-16229960d1b9 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.050237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d0843002-928a-464d-b7b6-33e67a0094b2 req-b86e29b6-2180-4f54-b138-16229960d1b9 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.050871 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d0843002-928a-464d-b7b6-33e67a0094b2 req-b86e29b6-2180-4f54-b138-16229960d1b9 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.068461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-d0843002-928a-464d-b7b6-33e67a0094b2 req-b86e29b6-2180-4f54-b138-16229960d1b9 service nova] Creating event network-changed:7f751c26-39f9-4ccf-bac7-cc25e0b849e4 for instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 on hv-cinder-85600 Sep 09 04:39:44.076227 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-d0843002-928a-464d-b7b6-33e67a0094b2 req-b86e29b6-2180-4f54-b138-16229960d1b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044777 Sep 09 04:39:44.077421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 45/88] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:39:44.199582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:44.200995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:44.227798 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:44.228854 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:44.236453 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.237446 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.238064 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.239914 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.240513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.241262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.261271 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.275062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.276911 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.277746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.281163 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.283293 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.293729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:44.503989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:44.515312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-20b2a3cc-0e25-4e35-951a-56747fb4610b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.293296 Sep 09 04:39:44.516512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 46/89] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:44 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:44.565095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:44.576981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:44.578673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:44.585002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-dd856052-0646-4246-88d4-cac59d5fd96e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.390370 Sep 09 04:39:44.585607 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 44/90] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:44 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:44.851574 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:44.852470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:44.859341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.860081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.860836 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.861722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.862542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.863255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.962816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:44.976471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:44.988894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.988894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.988894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:44.988894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:44.989180 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:44.989499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:45.029469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:45.037736 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-da5b1e27-34af-485d-b2b9-217e8a1a438d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.190859 Sep 09 04:39:45.052183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 47/91] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:44 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:45.203783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:45.214332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f4c30dd8-2946-4f9d-932b-e15c5831c5e8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.256388 Sep 09 04:39:45.215331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:44 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:45.540520 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:45.541136 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:45.547210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:45.547750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:45.548343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:45.549213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:45.549668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:45.550214 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:45.609753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:45.610525 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:45.618128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:45.622868 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:45.623495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:45.624447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:45.624915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:45.626050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:45.727023 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:45.741660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5644ccba-887d-42e3-8904-e48a4ba722eb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.207568 Sep 09 04:39:45.742258 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 48/93] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:45 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:45.810217 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:45.820996 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:45.822524 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:45.823672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-cbf7cf34-c3e4-4793-a6f9-d27f06675f4c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.217787 Sep 09 04:39:45.824404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 46/94] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:45 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:46.062792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:46.063677 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:46.071090 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.071702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.072213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:46.073334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.073795 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.074754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:46.079340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:46.233014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:46.243295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:46.243916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:46.250863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-71ff8a34-0503-472d-909b-1b8125547723 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.193095 Sep 09 04:39:46.251492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 49/95] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:46 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:46.255802 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.256991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.257574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:46.258789 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.259434 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.260004 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:46.450908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:46.460373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-69858e12-9b3f-4e57-a670-d10ce16d8600 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.220771 Sep 09 04:39:46.461682 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 47/96] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:46 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:46.767386 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:46.768210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:46.777231 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.778038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.778638 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:46.779556 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.780011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.780601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:46.849330 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:46.863230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:46.863230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.863230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.863230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:46.864399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:46.864399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:46.864399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:47.211412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:47.219183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-ccba98a7-6ac5-4337-afd3-f3d0b6ef0190 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.457238 Sep 09 04:39:47.219839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 50/97] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:46 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:47.220074 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:47.230797 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:47.232610 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:47.234158 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1b4a97e9-dca3-4ad0-bc6f-0cc013d2b8ef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.388839 Sep 09 04:39:47.241908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 48/98] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:46 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:47.275641 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:47.276732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:47.290192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:47.290192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:47.290192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:47.290192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:47.290513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:47.290513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:47.468940 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:47.477997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0e1aacf8-4bda-42d5-b573-9832f4f12862 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.206223 Sep 09 04:39:47.478578 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 51/99] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:47 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:47.485352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:47.487487 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:47.497218 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:47.497707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:47.498146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:47.499024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:47.499851 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:47.500482 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:47.669130 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:47.677709 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fd3d82eb-c269-46a8-8066-346dad1477f7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.197616 Sep 09 04:39:47.678440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 49/100] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:47 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:48.244525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:48.245060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:48.251154 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.251640 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.252074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.252761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.253238 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.253658 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.260921 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:48.261560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:48.267526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.268007 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.268441 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.269127 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.269683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.270149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.451318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:48.455698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:48.458967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7f66f5c7-33e8-4a0a-a7a7-067bdcac95ee tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.218342 Sep 09 04:39:48.467179 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 52/101] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:48 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:48.467325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:48.467325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:48.467325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-62639daa-0328-4ebd-8280-6f1673ae603b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.210926 Sep 09 04:39:48.467595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 50/102] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:48 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:48.501736 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:48.502270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:48.508129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.508611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.509049 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.509735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.510188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.510611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.635613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:48.643206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-34c81828-9128-4133-a58b-0706591e1359 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.145301 Sep 09 04:39:48.643775 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 53/103] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:48 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:48.700284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:48.700893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:48.706807 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.707363 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.707805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.708491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:48.708948 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:48.709371 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:48.840203 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:48.847785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-72aa7ac8-5e37-4f0c-a114-bf4c8a184f7b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.151267 Sep 09 04:39:48.849028 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 51/104] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:48 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:49.481629 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:49.482236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:49.488242 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.489284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.489713 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:49.490390 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.490837 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.491284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:49.492557 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:49.493174 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:49.498893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.499403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.499840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:49.500532 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.500986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.501407 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:49.681698 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:49.685156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:49.689897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-da43444e-ba07-46ad-a837-9e124776fcfb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.212151 Sep 09 04:39:49.690633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 54/105] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:49 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:49.694385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:49.695327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:49.695934 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:49.696032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:49.697044 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-08126738-cd2b-4ccb-8707-85f70a1103d2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.208876 Sep 09 04:39:49.697729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 52/106] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:49 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:49.701826 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.702309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.702750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:49.703572 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.704032 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.704460 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:49.830430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:49.838886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1bc3f9b5-4c32-4d3f-a509-4c15f660b5dc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1322 microversion: 2.1 time: 0.147010 Sep 09 04:39:49.839481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 55/107] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:49 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:49.871874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:49.872487 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:49.878263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.878738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.879240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:49.879928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:49.880380 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:49.880803 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:50.010460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:50.018214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8b91bf79-9ed1-465a-adeb-0e1b020fd127 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.150072 Sep 09 04:39:50.018853 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 53/108] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:49 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:50.237175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-f1cb46a2-e028-4593-81c3-ddc2685fc68e req-322ece84-0fdf-4d3d-88ab-4465c31504f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d", "name": "network-vif-plugged", "status": "completed", "tag": "0bd2a80e-3f55-4880-b053-2fd68ba4e2a3"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:50.247339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-f1cb46a2-e028-4593-81c3-ddc2685fc68e req-322ece84-0fdf-4d3d-88ab-4465c31504f6 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:50.248080 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-f1cb46a2-e028-4593-81c3-ddc2685fc68e req-322ece84-0fdf-4d3d-88ab-4465c31504f6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:50.248564 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-f1cb46a2-e028-4593-81c3-ddc2685fc68e req-322ece84-0fdf-4d3d-88ab-4465c31504f6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:50.261803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-f1cb46a2-e028-4593-81c3-ddc2685fc68e req-322ece84-0fdf-4d3d-88ab-4465c31504f6 service nova] Creating event network-vif-plugged:0bd2a80e-3f55-4880-b053-2fd68ba4e2a3 for instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d on hv-cinder-85600 Sep 09 04:39:50.269697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-f1cb46a2-e028-4593-81c3-ddc2685fc68e req-322ece84-0fdf-4d3d-88ab-4465c31504f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Sep 09 04:39:50.271480 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 56/109] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:39:50.720963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:50.721561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:50.723689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:50.724422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:50.728136 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:50.728623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:50.729060 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:50.729759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:50.730208 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:50.730633 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:50.732279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:50.733081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:50.733759 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:50.734524 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:50.734987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:50.735409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:50.928901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:50.931930 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:50.939776 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-105bf734-d3a7-4623-a578-97c681f46062 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.225703 Sep 09 04:39:50.941089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 54/110] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:50 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:50.941209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:50.946453 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:50.946582 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:50.947348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:50.947829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fefb7c15-206f-4071-a631-f44c0e6606ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.229815 Sep 09 04:39:50.948374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 57/111] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:50 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:50.964943 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:50.965426 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:50.965993 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:50.966698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:50.967225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:50.967649 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.043888 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:51.044489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:51.052773 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.064691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.065476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.066420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.067592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.068743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.285812 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:51.299938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e5213f25-626f-4db0-bda8-7ca8ce21ded7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1515 microversion: 2.1 time: 0.354532 Sep 09 04:39:51.299938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 55/112] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:50 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:51.322811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:39:51.325482 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:51.332744 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.333657 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.334172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.334888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.335508 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.336302 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.352004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:51.361890 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e62d3b05-7bce-4f15-a04b-9342b5e32f06 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.321317 Sep 09 04:39:51.378578 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 58/113] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:51 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:51.429168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lazy-loading 'flavor' on Instance uuid 7bc64fdf-1f32-4a6f-9194-af9ea4628027 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:39:51.732654 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-21c89f1f-2ac7-4ac8-bfcc-beba9eacd86d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027/action" status: 200 len: 32 microversion: 2.1 time: 0.413659 Sep 09 04:39:51.733647 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 56/114] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:39:51 2022] POST /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 04:39:51.746973 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:51.748965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:51.760668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.762186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.763360 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.765376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.766533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.767335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.965586 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:51.966963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:51.974103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.974671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.975204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:51.976129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:51.976636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:51.977357 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:52.039075 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:52.048609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f7543627-972f-456b-aaaf-8e8d1dfb37f2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.306322 Sep 09 04:39:52.058734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 59/115] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:51 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:52.066432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:52.067253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:52.073780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:52.074418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:52.075186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:52.076059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:52.076512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:52.077272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:52.157582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:52.166080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c0cdf5f6-8a74-4fcc-ae47-aeb5d334c629 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.205271 Sep 09 04:39:52.166653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 57/116] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:51 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:52.221528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:52.229501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:52.230956 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:52.232053 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1e5151c9-08a6-4b8e-b902-d9b48df1c517 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.180938 Sep 09 04:39:52.232821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 60/117] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:52 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:52.398052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:52.398662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:52.404625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:52.405102 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:52.405533 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:52.406217 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:52.406663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:52.407115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:52.535447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:52.538958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:52.543747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f6d4535b-538b-4eb4-b615-3a6728b0aca7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.150127 Sep 09 04:39:52.544404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 58/118] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:52 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:53.072723 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:53.073366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:53.079193 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.079674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.080103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.080787 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.081247 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.081652 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.190433 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:53.191414 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:53.199254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.199844 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.200541 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.201249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.201702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.202128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.214919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:53.223556 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-662cda6f-d207-4f28-9238-7d62f11630f0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.154328 Sep 09 04:39:53.224571 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 61/119] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:53 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:53.256188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:53.256778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:53.264382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.266025 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.266473 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.267217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.267673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.268095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.408857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:53.431970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ce170809-2625-433e-9c6a-993183d6e239 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.246803 Sep 09 04:39:53.432717 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 59/120] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:53 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:53.448004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:53.456743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:53.458283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:53.460459 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e7ab4d35-d711-4edd-a71f-7f495f919764 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.208516 Sep 09 04:39:53.461031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 62/121] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:53 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:53.566169 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:53.569571 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:53.580782 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.581263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.581699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.582384 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:53.582828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:53.583273 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:53.732899 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:53.741489 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3a352e0a-bc3a-4f80-b134-8987a1b483b5 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.179548 Sep 09 04:39:53.742072 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 60/122] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:53 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:54.247979 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:54.249018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:54.255189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.255663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.256094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.256833 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.257449 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.257869 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.395038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:54.403875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cc8cb188-6378-448f-a48c-bd4a8988d561 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.159507 Sep 09 04:39:54.416292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 63/123] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:54 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:54.456475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:54.457459 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:54.463329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.463809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.467135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.467135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.467135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.467135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.485863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:54.486771 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:54.493111 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.493899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.494417 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.495223 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.495738 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.496220 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.669710 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:54.678633 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7f91dde4-60e1-4716-99d2-3a3319ca1d3f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.226235 Sep 09 04:39:54.679765 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 61/124] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:54 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:54.690747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:54.700269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:54.702666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:54.702950 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-32c242a0-6b82-4653-abb6-4e0fac4224ce tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.221373 Sep 09 04:39:54.703498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 64/125] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:54 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:54.764643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:54.765502 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:54.774552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.775072 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.775511 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.776204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:54.776652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:54.777068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:54.911350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:54.922148 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-61d42895-67e6-4428-9e89-c554af137e57 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.161160 Sep 09 04:39:54.923127 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 62/126] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:54 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:55.427005 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:55.427616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:55.432495 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:55.434180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.434657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.435119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:55.435804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.436248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.436670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:55.564456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:55.572186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-39920249-730f-48fe-822d-0f6a4dcebe34 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.149580 Sep 09 04:39:55.572756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 65/127] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:55 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:55.702428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:55.703094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:55.709445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.709922 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.710369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:55.711062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.711509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.711925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:55.728148 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:55.729183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:55.735686 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.736267 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.737017 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:55.737530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.738198 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.738867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:55.761538 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:39:55.922552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:55.931256 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5930880e-31da-4c5f-a68f-c1650119b9b0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.232404 Sep 09 04:39:55.932069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 63/128] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:55 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:55.946372 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:55.952215 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:55.953278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:55.959767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:55.961298 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.961934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.962444 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:55.962546 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:55.963304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:55.963550 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b03e276c-f7d0-4b0e-b166-dc95c3a7b2dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.239377 Sep 09 04:39:55.964018 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:55.964149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 66/129] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:55 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:55.964832 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:56.130500 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:56.138451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-11bcc073-ea15-4dab-8ca0-955e9836b4ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.190061 Sep 09 04:39:56.139324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 64/130] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:55 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:39:56.595884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:56.596580 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:56.602851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:56.603483 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:56.603992 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:56.604763 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:56.605385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:56.605957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:56.742777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:56.750443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-60685448-b4bc-44fb-bf73-d6feab989e98 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.158662 Sep 09 04:39:56.751049 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 67/131] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:56 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:56.955673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:56.956274 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:56.962403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:56.962880 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:56.963349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:56.964032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:56.964511 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:56.964906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:56.990269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:56.999962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:57.008175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:57.012887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:57.013334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:57.014310 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:57.014777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:57.015276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:57.152020 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:57.160177 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c770084b-1da3-4868-aec1-4d75ab951aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.208450 Sep 09 04:39:57.161552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 65/132] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:56 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:57.166356 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:57.167187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:57.173013 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:57.173560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:57.174069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:57.174830 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:57.175587 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:57.175889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:57.204682 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:57.214705 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:57.216434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:57.217667 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6bd055ad-d026-41ee-8825-98ac2d0101ae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.232499 Sep 09 04:39:57.218475 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 68/133] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:56 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:57.309797 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:57.318403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bb6f6fb5-f56a-4095-8131-2e8d55edecd1 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.155681 Sep 09 04:39:57.319109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 66/134] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:57 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:57.773472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:57.774072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:57.779823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:57.780302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:57.780732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:57.781409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:57.781859 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:57.782275 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:57.910562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:57.918301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5c1fdfe7-7784-4e95-9cce-14995597e873 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.149235 Sep 09 04:39:57.919267 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:57 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:58.187290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:58.187290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:58.193552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.194709 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.195238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:58.195857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.196731 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.197171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:58.246632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:58.247781 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:58.255584 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.256363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.256989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:58.257917 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.258579 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.259035 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:58.412743 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:58.420719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3694281d-d0ed-4191-8535-4d52d4d0e431 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.240515 Sep 09 04:39:58.421318 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:58 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:58.426286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:58.426985 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:58.433637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.437609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.437609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:58.437609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.437609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.437946 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:58.444257 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:58.457037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:58.459357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:58.460684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c2f5002e-8f77-4d30-a56c-14f97c34bf3e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.219211 Sep 09 04:39:58.461936 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 70/137] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:58 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:39:58.594465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:58.605355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-560b0505-2638-4cc9-adb1-61e06f1b65f0 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1314 microversion: 2.1 time: 0.182673 Sep 09 04:39:58.606250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:58 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:58.943741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:58.944350 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:58.950729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.950882 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.951368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:58.952051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:58.952497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:58.952945 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:59.093269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:59.101614 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-205c334b-ff34-4234-b886-1fe6bf022b5d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.162941 Sep 09 04:39:59.102177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:58 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:59.444624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:59.445295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:59.451326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:59.451724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:59.452148 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:59.452942 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:59.453390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:59.453806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:59.487396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:59.487911 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:59.494956 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:59.495509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:59.495955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:59.496696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:59.497159 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:59.497585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:59.671901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:59.676628 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:59.680341 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a08d87f0-fe74-4d81-b0a1-7cf0ca679bc0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.239709 Sep 09 04:39:59.681008 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 69/140] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:59 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:39:59.685440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:39:59.686039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:39:59.692729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:59.693212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:59.701938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:59.702132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:59.702735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:39:59.703190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:39:59.703695 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:59.704900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-49691e6b-2a02-4275-92b8-dbbe3b6f7515 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.221986 Sep 09 04:39:59.705157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:39:59.705949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 72/141] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:39:59 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:39:59.867027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:39:59.876698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8abb5810-7ddd-4105-93ec-08124b520a14 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1501 microversion: 2.1 time: 0.194783 Sep 09 04:39:59.877560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 70/142] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:39:59 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:00.125413 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:00.126632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:00.138839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:00.139460 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:00.142566 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:00.144875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:00.145366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:00.145809 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:00.412441 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:00.423633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8c9b5b55-ae41-4c72-a70c-c6ae58c1f060 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.302299 Sep 09 04:40:00.424617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:00 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:00.709831 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:00.711594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:00.746139 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:00.751660 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:00.753697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:00.766862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:00.767685 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:00.768939 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:00.770251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:00.778024 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:00.778358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:00.783344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:00.784343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:00.787328 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:00.789412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:00.793833 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:01.218270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:01.239875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:01.251219 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:01.251405 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-87f479c2-c385-41b4-b6fd-8c488a66c703 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.550027 Sep 09 04:40:01.267065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 71/144] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:00 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:01.280637 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:01.285872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-509f4201-a5e2-443e-9639-a32af6f3a00e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.552374 Sep 09 04:40:01.287589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 74/145] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:00 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:40:01.380027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "767bf691-1824-4ccf-adc4-41618b8ad4db"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:01.382840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:01.389697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:01.390205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:01.391459 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:01.392187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:01.392651 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:01.393081 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:01.458443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:01.464533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:01.482529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:01.483427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:01.484425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:01.486959 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:01.487972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:01.489073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:01.758953 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:01.777357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-92cf7e48-2193-400f-9443-2ca4320ff962 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.326292 Sep 09 04:40:01.791427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 75/146] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:01 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:02.059791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-709a3237-7a06-45a9-ae01-c5e0dbbb8226 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "POST /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683836 Sep 09 04:40:02.060418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 72/147] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:40:01 2022] POST /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:02.289539 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:02.290232 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:02.304666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:02.308368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:02.309831 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:02.310668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:02.312131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:02.314743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:02.335443 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:02.336607 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:02.355921 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:02.357800 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:02.359819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:02.362884 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:02.367519 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:02.369378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:02.824777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:02.834294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5737063d-5868-44ab-b67e-a4aa749e965b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.550382 Sep 09 04:40:02.834912 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 76/148] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:02 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:02.842439 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:02.843267 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:02.865210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:02.866980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:02.867551 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:02.868315 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:02.869108 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:02.869744 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:02.903049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:02.913953 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:02.919668 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:02.922680 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-efd6deea-38fb-4838-95b6-46c7571e6741 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.592548 Sep 09 04:40:02.934667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 73/149] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:02 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:40:03.063639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:03.073549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-be665ac9-6415-4216-90e1-580750e8834c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.237568 Sep 09 04:40:03.074434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 77/150] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:02 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:03.861442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:03.862051 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:03.874579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:03.875462 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:03.875699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:03.876403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:03.877012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:03.877677 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:03.883427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:03.950735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:03.951382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:03.959253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:03.959600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:03.964507 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:03.965409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:03.965788 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:03.966222 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:04.076462 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:04.085129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-49f67b13-97bf-4501-b0e4-04fcbd037fb8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.229380 Sep 09 04:40:04.086089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 74/151] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:03 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:04.105880 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:04.106706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:04.113535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:04.114326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:04.114916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:04.115810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:04.116407 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:04.116983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:04.155259 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:04.164754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:04.166340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:04.168150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a0024781-1c47-485a-92c5-ed7b3e3e9780 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.221456 Sep 09 04:40:04.169231 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 78/152] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:03 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:40:04.268335 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:04.278834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-319d834c-7b21-4046-be53-d1464fa8b5e7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.176677 Sep 09 04:40:04.279648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 75/153] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:04 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:05.111234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:05.111922 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:05.118610 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:05.119138 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:05.119573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:05.120274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:05.120713 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:05.121165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:05.193665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:05.194834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:05.218227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:05.219118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:05.219549 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:05.220474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:05.221124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:05.221517 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:05.276863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:05.284587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c6390102-8688-4f4d-8e92-0c039b12a648 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.177149 Sep 09 04:40:05.285710 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 79/154] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:05 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:05.306160 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:05.306767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:05.312595 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:05.313062 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:05.313535 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:05.314518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:05.314897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:05.315347 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:05.414265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:05.422577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:05.424111 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:05.425259 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fb269285-fca5-47f5-9830-43e639873925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.235954 Sep 09 04:40:05.425837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 76/155] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:05 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:40:05.457768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:05.465443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-ac1b2d70-0600-447a-93b0-63bf6ef001e9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.163437 Sep 09 04:40:05.466013 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 80/156] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:05 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:06.308348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:06.309061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:06.313188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=94 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:06.317655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:06.318144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:06.318579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:06.319301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:06.319759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:06.320180 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:06.451835 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:06.452449 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:06.455894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:06.466302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:06.466804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:06.467279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:06.468162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:06.468266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-48da5049-245f-419d-ae67-b6a4326a46ac tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.163571 Sep 09 04:40:06.468625 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:06.469340 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 77/157] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:06 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:06.469846 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:06.490179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:06.491181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:06.500420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:06.501122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:06.501765 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:06.503070 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:06.503823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:06.505034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:06.680538 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:06.688512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:06.690248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:06.691381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fe977b43-f0e9-443c-bc37-562fee82fc45 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.244972 Sep 09 04:40:06.692466 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 81/158] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:06 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:40:06.711196 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:06.718812 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-62f4eec4-bad2-4c9a-822f-5076e842f7bc tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.233327 Sep 09 04:40:06.719468 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 78/159] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:06 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:07.491613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:07.492194 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:07.499264 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:07.499963 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:07.500432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:07.501137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:07.501779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:07.502448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:07.675371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:07.684268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8f7c8ece-ae1a-4b26-98aa-f7f1b17e4aef tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.197229 Sep 09 04:40:07.685872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 82/160] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:07 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:07.717317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:07.718049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:07.728521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:07.729005 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:07.729438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:07.744138 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:07.744905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:07.745495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:07.747012 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:07.747677 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:07.763242 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:07.763634 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:07.767383 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:07.768303 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:07.768939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:07.769530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:07.811195 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:07.977765 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:07.988117 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:07.990348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:07.991928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a9beb32d-5d1f-40e7-bfaa-0bed0084b72e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.278818 Sep 09 04:40:07.992906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 79/161] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:07 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:40:08.017055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:08.025595 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f5fb80ab-96ae-47bf-a0b3-694540288d9c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.283685 Sep 09 04:40:08.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:07 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:08.146520 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-8f4cf85a-0a71-42b4-8897-d25b8049eedb req-c3d2fdd3-d168-49bd-bd58-845972d4e3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee805de-a9e3-4596-9b43-d7cdc17b9e96", "name": "network-vif-plugged", "status": "completed", "tag": "7f751c26-39f9-4ccf-bac7-cc25e0b849e4"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:08.157781 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-8f4cf85a-0a71-42b4-8897-d25b8049eedb req-c3d2fdd3-d168-49bd-bd58-845972d4e3c9 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:08.158449 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-8f4cf85a-0a71-42b4-8897-d25b8049eedb req-c3d2fdd3-d168-49bd-bd58-845972d4e3c9 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:08.159139 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-8f4cf85a-0a71-42b4-8897-d25b8049eedb req-c3d2fdd3-d168-49bd-bd58-845972d4e3c9 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:08.173362 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-8f4cf85a-0a71-42b4-8897-d25b8049eedb req-c3d2fdd3-d168-49bd-bd58-845972d4e3c9 service nova] Creating event network-vif-plugged:7f751c26-39f9-4ccf-bac7-cc25e0b849e4 for instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 on hv-cinder-85600 Sep 09 04:40:08.178998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-8f4cf85a-0a71-42b4-8897-d25b8049eedb req-c3d2fdd3-d168-49bd-bd58-845972d4e3c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036374 Sep 09 04:40:08.179840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 80/163] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:08.711757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:08.712541 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:08.719466 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:08.719950 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:08.720443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:08.721325 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:08.721780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:08.724171 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:08.859364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:08.867685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e1323612-8e39-47cf-abf5-7d7b398ca43f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.160837 Sep 09 04:40:08.868255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 84/164] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:08 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:09.025662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:09.025662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:09.026541 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:09.027989 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:09.028491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:09.029690 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:09.030335 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:09.030757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:09.048590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:09.049590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:09.056007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:09.056492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:09.056925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:09.057784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:09.058241 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:09.058831 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:09.220050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:09.228965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:09.230461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:09.231613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f92e2bfa-49de-482f-8005-faf8fe74a40d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.217889 Sep 09 04:40:09.232862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 81/165] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:09 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:40:09.287803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:09.301707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6e33588b-4da5-4240-8619-25190275a653 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.256639 Sep 09 04:40:09.302299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 85/166] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:09 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:09.892470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:09.893068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:09.899994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:09.900538 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:09.900971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:09.901708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:09.902155 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:09.902572 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:10.039981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:10.047942 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5d27a009-cdd5-4849-b592-c49466038aa8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1361 microversion: 2.1 time: 0.159330 Sep 09 04:40:10.048585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 82/167] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:09 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:10.207953 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-1318835b-63b4-4560-8443-e8c9ceb60c2a req-73d1bacb-9976-43de-940f-a254651679fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e", "name": "network-vif-plugged", "status": "completed", "tag": "4024da04-efc2-4a91-b9ed-e97cc0ac1f78"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:10.217424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-1318835b-63b4-4560-8443-e8c9ceb60c2a req-73d1bacb-9976-43de-940f-a254651679fa service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:10.217899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-1318835b-63b4-4560-8443-e8c9ceb60c2a req-73d1bacb-9976-43de-940f-a254651679fa service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:10.218327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-1318835b-63b4-4560-8443-e8c9ceb60c2a req-73d1bacb-9976-43de-940f-a254651679fa service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:10.229009 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-1318835b-63b4-4560-8443-e8c9ceb60c2a req-73d1bacb-9976-43de-940f-a254651679fa service nova] Creating event network-vif-plugged:4024da04-efc2-4a91-b9ed-e97cc0ac1f78 for instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e on hv-cinder-85600 Sep 09 04:40:10.234164 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-1318835b-63b4-4560-8443-e8c9ceb60c2a req-73d1bacb-9976-43de-940f-a254651679fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 Sep 09 04:40:10.234784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 86/168] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:10.258064 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:10.258695 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:10.264570 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:10.265046 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:10.265482 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:10.266295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:10.266746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:10.267194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:10.326109 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:10.326755 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:10.333477 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:10.333960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:10.334401 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:10.335124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:10.335579 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:10.336000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:10.439525 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:10.454659 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:10.457679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:10.458816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-86f25dd8-7d3d-41c2-b016-1f14ffb8514c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.205142 Sep 09 04:40:10.476639 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 83/169] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:10 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:40:10.498352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:10.506983 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-dcc2f0c6-b935-462f-a460-94c86a86f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.185138 Sep 09 04:40:10.507825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:10 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:11.071100 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:11.072602 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:11.078724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.079360 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.079927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.080714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.081308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.081994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.221510 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:11.229527 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c75925fe-d11c-49bc-8d5e-7ea4350d1a77 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1548 microversion: 2.1 time: 0.163235 Sep 09 04:40:11.230107 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 84/171] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:11 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:11.252971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:11.253554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:11.260610 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.260989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.261432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.262158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.262606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.263080 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.389042 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b67ef207-3bee-4b61-8d55-a239e2042f06 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139935 Sep 09 04:40:11.389657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 88/172] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:40:11 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:11.483871 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:11.484479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:11.490795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.491328 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.491762 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.492455 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.492909 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.493332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.530979 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:11.531593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:11.537530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.538010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.538445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.539171 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:11.539621 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:11.540046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:11.807268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:11.816730 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:11.818179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:11.819306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2579f07a-2b9c-4cea-995f-5fe9779edf30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1407 microversion: 2.20 time: 0.339282 Sep 09 04:40:11.819869 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 85/173] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:11 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:40:11.868221 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:11.876152 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-182e584d-3a02-4bf3-a07c-240b197ade2e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.348834 Sep 09 04:40:11.876728 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:11 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:12.846764 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:12.852595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:12.876455 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:12.877505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:12.878754 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:12.880584 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:12.882094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:12.883961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:12.902644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:12.904598 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:12.924319 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:12.925211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:12.926671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:12.928286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:12.929218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:12.930085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:13.577167 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:13.586910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:13.592912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:13.594708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-972172c0-97d0-4250-9901-878441b78583 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.698057 Sep 09 04:40:13.603256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 90/175] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:12 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:13.604661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:13.608527 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b50b1821-0b90-475d-b680-b9fce28e95c5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1598 microversion: 2.20 time: 0.767394 Sep 09 04:40:13.609945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 86/176] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:40:12 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1598 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:40:13.636715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:13.637254 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:13.648263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:13.648769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:13.649210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:13.649977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:13.650371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:13.650997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:13.918211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c8e519f1-8501-4c69-9910-ec07d86b5a2c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.285761 Sep 09 04:40:13.919663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 91/177] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Sep 9 04:40:13 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:40:14.038428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-89e90ec1-8ed1-408b-9542-a15f565945a4 req-c21acaac-0abb-4c19-a6f8-9461f5eb28bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee805de-a9e3-4596-9b43-d7cdc17b9e96", "tag": "7f751c26-39f9-4ccf-bac7-cc25e0b849e4"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:14.051469 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-89e90ec1-8ed1-408b-9542-a15f565945a4 req-c21acaac-0abb-4c19-a6f8-9461f5eb28bb service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:14.052188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-89e90ec1-8ed1-408b-9542-a15f565945a4 req-c21acaac-0abb-4c19-a6f8-9461f5eb28bb service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:14.053036 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-89e90ec1-8ed1-408b-9542-a15f565945a4 req-c21acaac-0abb-4c19-a6f8-9461f5eb28bb service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:14.066123 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-89e90ec1-8ed1-408b-9542-a15f565945a4 req-c21acaac-0abb-4c19-a6f8-9461f5eb28bb service nova] Creating event network-changed:7f751c26-39f9-4ccf-bac7-cc25e0b849e4 for instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 on hv-cinder-85600 Sep 09 04:40:14.078354 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-89e90ec1-8ed1-408b-9542-a15f565945a4 req-c21acaac-0abb-4c19-a6f8-9461f5eb28bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041721 Sep 09 04:40:14.079818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 87/178] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:14.618277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:14.618804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:14.626057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:14.626848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:14.627301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:14.628197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:14.629475 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:14.630106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:14.866223 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:14.877643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4e87aa00-f930-48b2-b8ee-ebf3ca1dcb00 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.263176 Sep 09 04:40:14.879134 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 92/179] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:14 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:15.913686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:15.914394 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:15.930265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:15.931644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:15.932425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:15.933591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:15.934204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:15.934787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:16.203756 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:16.215023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-30461184-1bcf-4167-9514-aff4f015a313 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.306932 Sep 09 04:40:16.216118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 88/180] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:15 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:16.743881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:16.745900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:16.759838 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:16.761619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:16.764509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:16.769121 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:16.770401 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:16.771891 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:16.857729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:40:17.019569 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cc0b08f2-72ed-4971-a4bd-2e4aae1d4afd tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 204 len: 0 microversion: 2.1 time: 0.293634 Sep 09 04:40:17.019569 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 93/181] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:40:16 2022] DELETE /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:40:17.028022 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:17.028809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:17.036383 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:17.037007 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:17.037535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:17.038372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:17.038950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:17.039471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:17.236957 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:17.240118 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:17.240813 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:17.248514 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7642c7de-e204-42fe-ad25-7322cbaf787b tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1553 microversion: 2.1 time: 0.223025 Sep 09 04:40:17.250815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 89/182] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:17 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:17.261065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:17.263739 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:17.264438 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:17.266004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:17.266722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:17.267405 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:17.552508 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:17.561016 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-76dedf4b-d07b-44b5-b717-4e6ab3e05b60 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.325586 Sep 09 04:40:17.565484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 94/183] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:17 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:17.598205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-916a4700-3eec-4401-859f-4345fd49eb89 req-c1322ed7-a91d-4b9e-94cf-9c4ec58ab297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e", "tag": "4024da04-efc2-4a91-b9ed-e97cc0ac1f78"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:17.618039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-916a4700-3eec-4401-859f-4345fd49eb89 req-c1322ed7-a91d-4b9e-94cf-9c4ec58ab297 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:17.618769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-916a4700-3eec-4401-859f-4345fd49eb89 req-c1322ed7-a91d-4b9e-94cf-9c4ec58ab297 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:17.619376 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-916a4700-3eec-4401-859f-4345fd49eb89 req-c1322ed7-a91d-4b9e-94cf-9c4ec58ab297 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:17.634102 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-916a4700-3eec-4401-859f-4345fd49eb89 req-c1322ed7-a91d-4b9e-94cf-9c4ec58ab297 service nova] Creating event network-changed:4024da04-efc2-4a91-b9ed-e97cc0ac1f78 for instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e on hv-cinder-85600 Sep 09 04:40:17.642243 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-916a4700-3eec-4401-859f-4345fd49eb89 req-c1322ed7-a91d-4b9e-94cf-9c4ec58ab297 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046820 Sep 09 04:40:17.651705 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 90/184] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:18.274470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:18.276002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:18.286242 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:18.287506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:18.288131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:18.292400 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:18.293435 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:18.294459 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:18.496879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:18.511460 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4c4e4276-7607-4cf0-bd72-0b7696dafab7 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1553 microversion: 2.1 time: 0.240607 Sep 09 04:40:18.512404 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 95/185] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:18 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:18.592907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:18.593358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:18.601137 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:18.601637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:18.602076 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:18.603043 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:18.603702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:18.604126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:18.903778 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:18.914460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e7e09df7-a557-4289-9965-10abdc56d4fe tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.327266 Sep 09 04:40:18.915065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 91/186] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:18 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:19.547579 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:19.548917 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:19.562416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:19.563169 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:19.563766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:19.564884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:19.571625 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:19.572259 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:19.819746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:19.828759 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9499b4e7-8e87-40b1-b2a1-1d65e7ff27ea tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1553 microversion: 2.1 time: 0.285497 Sep 09 04:40:19.829344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 96/187] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:19 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:19.943526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:19.944226 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:19.955209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:19.955725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:19.956156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:19.977759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:19.977759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:19.977759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:20.218850 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:20.237535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:20.240144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b7b8a3f9-02a3-430f-87e2-abff4bbee66c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.301284 Sep 09 04:40:20.240843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 92/188] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:19 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:20.852561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:20.853791 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:20.866385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:20.866884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:20.867870 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:20.868049 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:20.870420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:20.870972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:20.961849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-135667399", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "networks": [{"uuid": "84967da4-2d71-4732-bbc3-ec5f9c426a3c"}]}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:20.992439 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:21.014103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8eb6eb53-5481-4b4a-9dad-352f7160e78a tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1511 microversion: 2.1 time: 0.165591 Sep 09 04:40:21.014698 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 97/189] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:20 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:21.021847 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-06a90034-627d-4cbb-a879-9db0ff397664 req-783e4e07-e6a5-4b1d-84b2-fdbc6f8d199d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d", "name": "network-vif-deleted", "tag": "0bd2a80e-3f55-4880-b053-2fd68ba4e2a3"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:21.040617 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] validate_networks() for [('84967da4-2d71-4732-bbc3-ec5f9c426a3c', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:40:21.042645 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-06a90034-627d-4cbb-a879-9db0ff397664 req-783e4e07-e6a5-4b1d-84b2-fdbc6f8d199d service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:21.043385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-06a90034-627d-4cbb-a879-9db0ff397664 req-783e4e07-e6a5-4b1d-84b2-fdbc6f8d199d service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:21.044077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-06a90034-627d-4cbb-a879-9db0ff397664 req-783e4e07-e6a5-4b1d-84b2-fdbc6f8d199d service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:21.060242 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-06a90034-627d-4cbb-a879-9db0ff397664 req-783e4e07-e6a5-4b1d-84b2-fdbc6f8d199d service nova] Creating event network-vif-deleted:0bd2a80e-3f55-4880-b053-2fd68ba4e2a3 for instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d on hv-cinder-85600 Sep 09 04:40:21.066211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-06a90034-627d-4cbb-a879-9db0ff397664 req-783e4e07-e6a5-4b1d-84b2-fdbc6f8d199d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048910 Sep 09 04:40:21.067013 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 98/190] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:21.264544 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:21.265259 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:21.271874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:21.272412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:21.272818 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:21.273511 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:21.274224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:21.274382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:21.479742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:21.487340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1ec22a56-42a8-466a-af16-66a92e0da39c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.227549 Sep 09 04:40:21.487903 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 99/191] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:21 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:21.525100 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:40:21.525518 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:40:21.525982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:40:21.526384 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:40:21.526788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:40:21.535462 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:21.535934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:21.536371 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:21.537089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:21.537536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:21.537980 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:21.554042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Getting quotas for project ce9bbaae5d5e4e26a6ff2e9d4a1f98c3. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:40:21.557971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Getting quotas for user 64bf0fc10c794dc88efe25cf21ced674 and project ce9bbaae5d5e4e26a6ff2e9d4a1f98c3. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:40:21.569623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:40:21.571925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:40:21.615907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e25d3103-f5c9-4d73-a0e2-5b7606d65426 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657964 Sep 09 04:40:21.616732 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 93/192] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 04:40:21.627952 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-90758bb2-6a04-45bc-b7da-1cfc3edfa7c4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:21.629249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-90758bb2-6a04-45bc-b7da-1cfc3edfa7c4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:21.712083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-90758bb2-6a04-45bc-b7da-1cfc3edfa7c4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:21.723343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-90758bb2-6a04-45bc-b7da-1cfc3edfa7c4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1213 microversion: 2.1 time: 0.099402 Sep 09 04:40:21.724572 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 100/193] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:21 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:22.040906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:22.041601 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:22.047844 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:22.048402 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:22.048904 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:22.049670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:22.050189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:22.051264 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:22.090560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:22.091065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:22.091498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:22.091957 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lazy-loading 'fault' on Instance uuid d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:40:22.155309 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '161e111ce6384c0caadaa06d4bcffee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cc9340f30fa4e299fd096d27b9c7dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:22.163894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-237d2cee-03c8-4b9f-a654-faac3950b277 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 200 len: 1350 microversion: 2.1 time: 0.127820 Sep 09 04:40:22.164673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 94/194] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:22 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 1350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:22.509639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:22.510295 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:22.516801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:22.517288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:22.517731 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:22.518422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:22.518905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:22.519537 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:22.524492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:22.666805 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:22.674737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f588782a-9e4e-4851-aa10-8987334cc63d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.168901 Sep 09 04:40:22.675355 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 101/195] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:22 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:22.746268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:22.746874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:22.753240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:22.753725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:22.754335 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:22.755466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:22.755940 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:22.756336 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:22.822429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:22.830421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8cbc959a-4547-4dd0-bad8-40bcd4ffd4df tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1209 microversion: 2.1 time: 0.088028 Sep 09 04:40:22.839542 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 95/196] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:22 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:23.187138 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:23.187749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:23.194664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.195177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.195616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.196311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.196764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.197190 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.212407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] HTTP exception thrown: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Request method failure captured: Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d HTTP/1.1 Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNvyHAzFPBpUq2IqPfWiS-ZuLkYrwhU5wJP0ZEGUgqF5uFUfKQM6upWM6UpbBeD1-dz1aE-fHfmVJjxfYCHHVWDiCrK86JGi2ivIVTEKFvJuhc2hOY6_-vDyTonq9X3aiN9TBhfkInhWzV-UoybCoE4ubBW-ZB_kh2NnXFQKbUsR4o Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:40:23.217228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}] Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 161e111ce6384c0caadaa06d4bcffee2 Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.218819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'd5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d'} Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:40:23.219768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.221071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.222073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Returning 404 to user: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:40:23.222073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7bf8a147-1c36-4eb3-9728-2485b0a553e3 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 404 len: 111 microversion: 2.1 time: 0.035514 Sep 09 04:40:23.222073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 102/197] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:23 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:40:23.340812 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:23.343084 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:23.350203 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.350965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.351390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.352100 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.352546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.352965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.366583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] HTTP exception thrown: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Request method failure captured: Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d/os-volume_attachments HTTP/1.1 Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNvyHAzFPBpUq2IqPfWiS-ZuLkYrwhU5wJP0ZEGUgqF5uFUfKQM6upWM6UpbBeD1-dz1aE-fHfmVJjxfYCHHVWDiCrK86JGi2ivIVTEKFvJuhc2hOY6_-vDyTonq9X3aiN9TBhfkInhWzV-UoybCoE4ubBW-ZB_kh2NnXFQKbUsR4o Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:40:23.370759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}] Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 161e111ce6384c0caadaa06d4bcffee2 Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.372187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'server_id': 'd5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d'} Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:40:23.372964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:23.377918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:23.380270 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Returning 404 to user: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:40:23.380270 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c0813a84-e74d-4203-9d20-9ef6623d3a95 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035284 Sep 09 04:40:23.380270 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 96/198] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:40:23 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:40:23.699112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:23.699724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:23.711545 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.712113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.713290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.714017 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.714591 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.715339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.855415 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:23.856259 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:23.867195 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.867898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.868417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.869360 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:23.870008 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:23.870701 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:23.902739 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:23.933103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a0695b87-08cb-4778-b3d8-c5554a4bf271 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.237671 Sep 09 04:40:23.933692 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 103/199] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:23 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:23.966331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:23.974874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-117c7fb0-5c12-4f5c-aee1-1b04544366e7 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1271 microversion: 2.1 time: 0.124361 Sep 09 04:40:23.975455 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 97/200] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:23 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:24.595783 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:24.596680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:24.603561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:24.604226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:24.604910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:24.605986 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:24.606675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:24.607358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:24.624510 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] HTTP exception thrown: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Request method failure captured: Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: DELETE /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d HTTP/1.1 Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNvyHAzFPBpUq2IqPfWiS-ZuLkYrwhU5wJP0ZEGUgqF5uFUfKQM6upWM6UpbBeD1-dz1aE-fHfmVJjxfYCHHVWDiCrK86JGi2ivIVTEKFvJuhc2hOY6_-vDyTonq9X3aiN9TBhfkInhWzV-UoybCoE4ubBW-ZB_kh2NnXFQKbUsR4o Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:40:24.626715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}] Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 161e111ce6384c0caadaa06d4bcffee2 Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.628273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'd5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d'} Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:40:24.629099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.630407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.632272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Returning 404 to user: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:40:24.633740 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-314436ef-7ac0-433c-9b24-bb09a265361f tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 404 len: 111 microversion: 2.1 time: 0.042151 Sep 09 04:40:24.634444 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 104/201] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:40:24 2022] DELETE /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:40:24.647151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:24.647151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] [instance: d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:24.652228 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:24.652722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:24.653273 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:24.654195 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:24.654648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:24.655328 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:24.671200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] HTTP exception thrown: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Request method failure captured: Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d HTTP/1.1 Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNvyHAzFPBpUq2IqPfWiS-ZuLkYrwhU5wJP0ZEGUgqF5uFUfKQM6upWM6UpbBeD1-dz1aE-fHfmVJjxfYCHHVWDiCrK86JGi2ivIVTEKFvJuhc2hOY6_-vDyTonq9X3aiN9TBhfkInhWzV-UoybCoE4ubBW-ZB_kh2NnXFQKbUsR4o Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:40:24.673428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8cc9340f30fa4e299fd096d27b9c7dbd"}]}] Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 8cc9340f30fa4e299fd096d27b9c7dbd Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-DeleteServersTestJSON-96178213 Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 161e111ce6384c0caadaa06d4bcffee2 Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-DeleteServersTestJSON-96178213-project Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.674856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'd5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d'} Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:40:24.675619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. Sep 09 04:40:24.677726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:24.678892 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] Returning 404 to user: Instance d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:40:24.678892 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-af7d919b-4635-4152-8b53-a2ea313097d8 tempest-DeleteServersTestJSON-96178213 tempest-DeleteServersTestJSON-96178213-project] 10.222.0.20 "GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d" status: 404 len: 111 microversion: 2.1 time: 0.035699 Sep 09 04:40:24.680059 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 98/202] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:24 2022] GET /compute/v2.1/servers/d5a9c15b-65d0-4cf0-ad37-d8e4eb0e001d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:40:24.960322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:24.961685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:24.972128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:24.975160 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:24.975964 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:24.976855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:24.977306 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:24.977945 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:24.997672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:24.998542 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:25.004855 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:25.005619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:25.006256 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:25.007222 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:25.007885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:25.008490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:25.339000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:25.350395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b9f428a5-4b33-42a5-8d64-406089098ed7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.394946 Sep 09 04:40:25.351448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 105/203] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:24 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:25.352912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:25.364492 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2a494c4f-6705-417d-9631-13092c3aea93 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.370041 Sep 09 04:40:25.366295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 99/204] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:24 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:25.560910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-cb541a13-d2b9-41c4-a399-7e1e8e1af154 req-e5035c8a-bea5-4d52-86e1-69ecc34e0d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68272816-0af9-49ec-90e0-dbc050690a31", "tag": "75596c8a-454a-49f3-aa06-0e4895a2f156"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:25.566121 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:25.580976 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cb541a13-d2b9-41c4-a399-7e1e8e1af154 req-e5035c8a-bea5-4d52-86e1-69ecc34e0d16 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:25.581663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cb541a13-d2b9-41c4-a399-7e1e8e1af154 req-e5035c8a-bea5-4d52-86e1-69ecc34e0d16 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:25.582910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cb541a13-d2b9-41c4-a399-7e1e8e1af154 req-e5035c8a-bea5-4d52-86e1-69ecc34e0d16 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:25.597963 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-cb541a13-d2b9-41c4-a399-7e1e8e1af154 req-e5035c8a-bea5-4d52-86e1-69ecc34e0d16 service nova] Creating event network-changed:75596c8a-454a-49f3-aa06-0e4895a2f156 for instance 68272816-0af9-49ec-90e0-dbc050690a31 on hv-cinder-85600 Sep 09 04:40:25.617677 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-cb541a13-d2b9-41c4-a399-7e1e8e1af154 req-e5035c8a-bea5-4d52-86e1-69ecc34e0d16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059782 Sep 09 04:40:25.618751 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 106/205] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:26.373603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:26.374323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:26.381310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:26.381871 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:26.382304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:26.383021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:26.383471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:26.383891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:26.392924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:26.394000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:26.400319 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:26.400803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:26.401236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:26.401961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:26.402551 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:26.403178 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:26.726099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:26.726282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:26.733911 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-dcc9487f-8914-4873-bc1c-60d79a5df291 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.346374 Sep 09 04:40:26.740262 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-561c1f5d-b8ab-4250-a5c1-c312510dcfa0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.369173 Sep 09 04:40:26.743421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 107/206] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:26 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:26.751853 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 100/207] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:26 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:27.771840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:27.773214 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:27.773773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:27.774542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:27.793830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:27.794332 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:27.794772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:27.795615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:27.796299 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:27.797109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:27.798484 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:27.799512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:27.800669 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:27.802289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:27.802707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:27.804402 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:28.091344 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:28.093860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:28.112439 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-aa87db69-976f-4202-8ba1-300bc8140035 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.348608 Sep 09 04:40:28.113854 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9dd88e3f-33b2-4022-ab26-d2f8ee77be24 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.358097 Sep 09 04:40:28.114961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 108/208] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:27 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:28.126953 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 101/209] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:27 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:29.139752 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:29.140583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:29.140720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:29.141760 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:29.148882 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:29.149363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:29.151530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:29.152265 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:29.152726 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:29.153154 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:29.167286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:29.168262 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:29.169028 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:29.170242 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:29.172578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:29.173308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:29.582380 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:29.597513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:29.604698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a2a7e78d-817c-4da1-8bc3-853ce92b2c7f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.469464 Sep 09 04:40:29.606539 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 102/210] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:29 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:29.618447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-71022d7e-cc41-4c42-a862-46a51685ac36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.471664 Sep 09 04:40:29.626490 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 109/211] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:29 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:30.632090 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:30.633008 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:30.639773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:30.640299 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:30.640747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:30.641472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:30.641988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:30.642360 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:30.650200 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:30.651124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:30.657240 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:30.657806 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:30.658318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:30.659291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:30.659864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:30.660352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:30.862960 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:30.875941 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:30.882564 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-de5e01de-3cc0-418a-9bab-2cc009f67476 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1521 microversion: 2.1 time: 0.251572 Sep 09 04:40:30.885228 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 103/212] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:30 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:30.888102 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c0be7f7e-1c8d-4446-bfda-129807aa4faf tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.241723 Sep 09 04:40:30.888834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 110/213] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:30 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:31.905662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:31.907388 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=6 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:31.912514 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:31.913275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:31.913898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:31.914321 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:31.922849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:31.925500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:31.927250 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:31.928090 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:31.930191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:31.931173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:31.931603 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:31.931988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:31.932448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:31.932681 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:31.933173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:31.933633 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:31.934230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:32.200293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:32.212692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:32.218168 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2b0fdf7d-0400-4b7e-9b42-98a1e1496f0b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.311469 Sep 09 04:40:32.233779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 111/214] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:31 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:32.233963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ecf62158-c1e5-4006-b418-9ff00e2f594a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1501 microversion: 2.1 time: 0.317278 Sep 09 04:40:32.233963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 104/215] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:31 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1501 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:32.245415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:32.246028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:32.252430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:32.253297 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:32.253742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:32.254484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:32.255256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:32.255698 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:32.269704 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-f7200615-4f82-4a44-85d0-36805622efd8 req-f03d830e-27ee-49b7-8ae1-04f521d563f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68272816-0af9-49ec-90e0-dbc050690a31", "name": "network-vif-plugged", "status": "completed", "tag": "75596c8a-454a-49f3-aa06-0e4895a2f156"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:32.284639 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f7200615-4f82-4a44-85d0-36805622efd8 req-f03d830e-27ee-49b7-8ae1-04f521d563f5 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:32.286381 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f7200615-4f82-4a44-85d0-36805622efd8 req-f03d830e-27ee-49b7-8ae1-04f521d563f5 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:32.287671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f7200615-4f82-4a44-85d0-36805622efd8 req-f03d830e-27ee-49b7-8ae1-04f521d563f5 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:32.309965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-f7200615-4f82-4a44-85d0-36805622efd8 req-f03d830e-27ee-49b7-8ae1-04f521d563f5 service nova] Creating event network-vif-plugged:75596c8a-454a-49f3-aa06-0e4895a2f156 for instance 68272816-0af9-49ec-90e0-dbc050690a31 on hv-cinder-85600 Sep 09 04:40:32.318634 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-f7200615-4f82-4a44-85d0-36805622efd8 req-f03d830e-27ee-49b7-8ae1-04f521d563f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060962 Sep 09 04:40:32.319482 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 105/216] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:40:32.445042 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:32.452771 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-655c739d-11dd-4a2e-bc8b-1cc67b52d5e0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1514 microversion: 2.1 time: 0.211283 Sep 09 04:40:32.468491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 112/217] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:32 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:33.244918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:33.245624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:33.256174 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:33.256887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:33.257661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:33.258364 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:33.258966 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:33.259524 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:33.516218 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:33.524246 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-93cff6bb-8d0d-4d00-b817-b973514067f6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.286033 Sep 09 04:40:33.524931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 106/218] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:33 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:34.548035 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:34.548829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:34.556231 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:34.556855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:34.557525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:34.558414 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:34.558944 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:34.559972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:34.824464 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:34.833136 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7f141dab-5694-4b04-b737-544a388a567d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.288903 Sep 09 04:40:34.848459 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 113/219] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:34 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:35.857773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:35.858537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:35.867335 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:35.868363 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:35.868938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:35.869775 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:35.870823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:35.872115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:36.099138 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:36.109856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4b126fe2-9c76-4e89-b17e-40b90c49f70d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.255846 Sep 09 04:40:36.110303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 107/220] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:35 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:36.573593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c284c25b-f3b1-4031-b7de-ad931610984f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: .version_select at 0x7f43fae6e1f0>, body: {"keypair": {"name": "tempest-keypair-2094070471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPlj1zFj6d/fJm4yYIgJg9Icba+6MeoacW5mB42HC/5tqUyDRvzseI+fCcYHDMSm8hnf7hzPioamRn9QJkCN6KygNhC3jjegyJhrHiTd5tcDk22oKXKRGqDwNwahxL8uw=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:36.590083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-c284c25b-f3b1-4031-b7de-ad931610984f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:40:36.594054 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-c284c25b-f3b1-4031-b7de-ad931610984f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:40:36.617914 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c284c25b-f3b1-4031-b7de-ad931610984f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174908 Sep 09 04:40:36.618858 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 114/221] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:40:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:37.135809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:37.141050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:37.147852 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:37.155955 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:37.156447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:37.156877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:37.168430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:37.168430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:37.168802 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:37.245888 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:37.248186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:37.254850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:37.255637 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:37.256322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:37.257249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:37.257916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:37.258552 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:37.285875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lazy-loading 'flavor' on Instance uuid 86b22e86-a3f6-4e3d-bb20-2ef261176f1f {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:40:37.418708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d478e634-88b0-4b86-93b4-f5e4d6e3ebf2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f/action" status: 200 len: 32 microversion: 2.1 time: 0.176689 Sep 09 04:40:37.419717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 115/222] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:40:37 2022] POST /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 04:40:37.429269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:37.430221 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:37.436573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:37.437131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:37.437568 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:37.438538 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:37.439506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:37.440331 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:37.445782 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:37.455592 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-91d45de3-bb77-44fa-8fe6-69200c2b121b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1313 microversion: 2.1 time: 0.326159 Sep 09 04:40:37.456175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 108/223] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:37 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:37.659568 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:37.669491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c19dd856-8808-4454-875d-95e8327966ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.244316 Sep 09 04:40:37.670074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 116/224] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:37 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:38.206610 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-193452004", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0"}], "security_groups": [{"name": "tempest-securitygroup--773321531"}], "key_name": "tempest-keypair-2094070471", "user_data": "}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:38.341476 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] validate_networks() for [('38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:40:38.479299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:38.480158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:38.487728 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:38.488518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:38.489095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:38.489946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:38.490549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:38.491727 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:38.716769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:38.742185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-ea72bdbd-51f5-4dac-9424-2b3ec5f54e89 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1498 microversion: 2.1 time: 0.266311 Sep 09 04:40:38.759752 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 117/225] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:38 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1498 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:38.769385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:38.770757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:38.777555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:38.778286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:38.779060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:38.780056 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:38.780871 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:38.781673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:38.911487 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:40:38.911915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:40:38.912391 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:40:38.912954 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:40:38.913369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:40:38.922628 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:38.923540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:38.923713 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:38.924451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:38.924904 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:38.925332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:38.949027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:40:38.954348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:40:38.963161 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:38.966725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:38.973951 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8168c033-cd99-4995-9975-c9a6c60aff8d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.212728 Sep 09 04:40:38.994207 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 118/226] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:38 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:38.995561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:40:38.998234 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:40:39.052550 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-db5903b0-7f71-4ebd-bbb6-afca4366b441 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.849981 Sep 09 04:40:39.059245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 109/227] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:40:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:40:39.070231 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b071afe2-16e0-4bef-b11c-6010ab575fa6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:39.071228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b071afe2-16e0-4bef-b11c-6010ab575fa6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:39.146749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b071afe2-16e0-4bef-b11c-6010ab575fa6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:39.153764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b071afe2-16e0-4bef-b11c-6010ab575fa6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1241 microversion: 2.1 time: 0.092592 Sep 09 04:40:39.154530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 119/228] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:39 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:39.799260 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:39.800650 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:39.808420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:39.809119 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:39.809757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:39.810663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:39.811393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:39.812021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:39.852336 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:40:39.952995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:40.001834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-050c0565-908b-49be-b1c0-8eecf9120738 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "DELETE /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 204 len: 0 microversion: 2.1 time: 0.205500 Sep 09 04:40:40.002607 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:40.003691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:40.003880 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 110/229] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:40:39 2022] DELETE /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:40:40.015599 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:40.016079 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:40.017050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:40.017763 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:40.018218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:40.019736 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:40.020853 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:40.021974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:40.031590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:40.032369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:40.033130 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:40.037170 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:40.038154 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:40.038749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:40.302460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:40.315631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1a3d8814-8f6c-4878-a8ed-1341b1695cb5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1504 microversion: 2.1 time: 0.303057 Sep 09 04:40:40.316249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 111/230] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:40 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:40.324618 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:40.325591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:40.329802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:40.338803 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:40.339613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:40.340299 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:40.340667 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d2c387ff-3352-466f-bec7-5fa1e58c7ab1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.341802 Sep 09 04:40:40.341480 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 120/231] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:39 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:40.343347 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:40.344118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:40.345179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:40.427975 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:40.439106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-de5943c1-06f3-4aac-8e75-e457ba12ec9c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1293 microversion: 2.1 time: 0.121140 Sep 09 04:40:40.440481 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 112/232] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:40 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:41.340716 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:41.341991 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:41.349586 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:41.350204 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:41.350754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:41.351602 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:41.352133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:41.352829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:41.366410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:41.367048 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:41.381320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:41.381834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:41.382298 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:41.383154 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:41.383640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:41.384267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:41.559910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:41.568788 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-124a8b17-b037-428c-9800-f7f31e6e3ab4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1504 microversion: 2.1 time: 0.232145 Sep 09 04:40:41.569675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 121/233] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:41 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:41.574291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:41.574893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:41.580754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:41.581616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:41.582635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:41.583568 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:41.584209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:41.584420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:41.584949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:41.592339 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b5ba8756-14d0-4b7f-8f11-46555c8e99be tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.230645 Sep 09 04:40:41.593159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 113/234] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:41 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:41.648715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:41.656283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-302d2667-3c22-405b-9431-fce5122ce282 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1293 microversion: 2.1 time: 0.085484 Sep 09 04:40:41.656850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 122/235] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:41 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:42.592239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:42.592848 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:42.599230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:42.599712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:42.600144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:42.600828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:42.601274 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:42.601696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:42.615728 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:42.616344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:42.622757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:42.623291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:42.623724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:42.624447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:42.624883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:42.625305 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:42.760568 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:42.768446 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-63012585-0284-467e-bbce-87a73ba0db99 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.156724 Sep 09 04:40:42.769022 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 123/236] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:42 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:42.774072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:42.774608 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:42.780399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:42.780919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:42.781387 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:42.782088 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:42.782537 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:42.783021 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:43.060057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:43.069981 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f6f47e6c-487b-4fca-8264-d2807ea44888 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1293 microversion: 2.1 time: 0.299355 Sep 09 04:40:43.070985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 124/237] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:42 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1293 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:43.123627 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:43.131945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-05ece643-3384-47be-8d0c-fc28fedc195f tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1504 microversion: 2.1 time: 0.543499 Sep 09 04:40:43.132519 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 114/238] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:42 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:43.792445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:43.792977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:43.798763 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:43.799285 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:43.799722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:43.800406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:43.800855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:43.801273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:43.927409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:43.935073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f6ef7fee-126d-43e3-a68e-5ed6c074c6d4 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.146623 Sep 09 04:40:43.935634 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 125/239] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:43 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:44.093547 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:44.094191 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:44.100800 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:44.101278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:44.101714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:44.102405 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:44.102854 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:44.103302 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:44.155060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:44.155798 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:44.162374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:44.162938 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:44.163768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:44.164465 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:44.164914 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:44.165332 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:44.166909 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:44.174486 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a8d0515c-afc7-482b-9cb5-c82971bc3315 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1293 microversion: 2.1 time: 0.085274 Sep 09 04:40:44.175075 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 115/240] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:44 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:44.292318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:44.299982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-44a4a8f7-d8dd-4551-90d8-764b191fb552 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1504 microversion: 2.1 time: 0.148816 Sep 09 04:40:44.300488 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 126/241] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:44 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:44.957787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:44.958394 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:44.964710 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:44.965199 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:44.965631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:44.966556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:44.967030 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:44.967663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:45.135970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:45.147670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5995744a-9e6f-4312-ade4-803c26dc6db8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.193716 Sep 09 04:40:45.148728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 116/242] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:44 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:45.199060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:45.199957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:45.207393 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:45.207978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:45.208475 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:45.209194 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:45.209650 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:45.210081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:45.286472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:45.297608 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-82e470fe-9ac0-4937-83d6-3a508f94136b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1299 microversion: 2.1 time: 0.104003 Sep 09 04:40:45.298363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 127/243] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:45 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:45.323519 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:45.324347 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:45.331184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:45.331747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:45.333155 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:45.334498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:45.335697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:45.336563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:45.404077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:45.413098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-640892f6-99cb-45be-a5d7-3d73787e3c00 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1462 microversion: 2.1 time: 0.093410 Sep 09 04:40:45.413673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 117/244] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:45 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:45.531651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-e23ee5ee-dab5-462b-b164-9853677dee33 req-375e7419-b096-4c09-a1b1-8884553e8254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68272816-0af9-49ec-90e0-dbc050690a31", "name": "network-vif-deleted", "tag": "75596c8a-454a-49f3-aa06-0e4895a2f156"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:45.541138 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-e23ee5ee-dab5-462b-b164-9853677dee33 req-375e7419-b096-4c09-a1b1-8884553e8254 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:45.541611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-e23ee5ee-dab5-462b-b164-9853677dee33 req-375e7419-b096-4c09-a1b1-8884553e8254 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:45.542034 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-e23ee5ee-dab5-462b-b164-9853677dee33 req-375e7419-b096-4c09-a1b1-8884553e8254 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:45.565773 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-e23ee5ee-dab5-462b-b164-9853677dee33 req-375e7419-b096-4c09-a1b1-8884553e8254 service nova] Creating event network-vif-deleted:75596c8a-454a-49f3-aa06-0e4895a2f156 for instance 68272816-0af9-49ec-90e0-dbc050690a31 on hv-cinder-85600 Sep 09 04:40:45.574284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-e23ee5ee-dab5-462b-b164-9853677dee33 req-375e7419-b096-4c09-a1b1-8884553e8254 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046427 Sep 09 04:40:45.575389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 128/245] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:46.172045 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:46.172648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:46.180910 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:46.181395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:46.181838 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:46.182531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:46.182996 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:46.183434 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:46.326526 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:46.331077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:46.333474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:46.342062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9f708261-39cd-4a24-ba2d-731b16a9e35a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.173741 Sep 09 04:40:46.343075 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 118/246] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:46 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:46.360718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:46.361210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:46.361639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:46.362339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:46.362787 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:46.363237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:46.436470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:46.437081 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:46.444538 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:46.445289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:46.446267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:46.449244 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:46.450379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:46.451188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:46.516263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:46.528743 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:46.530541 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:46.531657 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lazy-loading 'fault' on Instance uuid 68272816-0af9-49ec-90e0-dbc050690a31 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:40:46.593888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:46.601791 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:46.602638 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0b9d3841-9feb-499b-9e30-f14816160fc3 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 200 len: 1303 microversion: 2.1 time: 0.170328 Sep 09 04:40:46.603330 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 119/247] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:46 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:46.610947 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-93237982-23a8-4123-b051-9403de69e7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.288961 Sep 09 04:40:46.621000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 129/248] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:46 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:47.365294 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:47.366060 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:47.372323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:47.372806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:47.373240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:47.373926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:47.374375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:47.374822 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:47.502958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:47.510700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5fcdbcb2-9a45-41ec-864c-4c75739cc6ba tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.149447 Sep 09 04:40:47.511299 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 120/249] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:47 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:47.588783 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-470a3125-8bb4-40f0-b0b3-517177b3b420 req-0f542d83-46eb-4dd5-972c-e0f68e4d945b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e092d2-0c03-4288-be1b-f0f2da7f5de2", "tag": "3478642f-a083-41dc-8630-0f933d8c0ed9"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:47.598008 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-470a3125-8bb4-40f0-b0b3-517177b3b420 req-0f542d83-46eb-4dd5-972c-e0f68e4d945b service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:47.598481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-470a3125-8bb4-40f0-b0b3-517177b3b420 req-0f542d83-46eb-4dd5-972c-e0f68e4d945b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:47.599105 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-470a3125-8bb4-40f0-b0b3-517177b3b420 req-0f542d83-46eb-4dd5-972c-e0f68e4d945b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:47.609879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-470a3125-8bb4-40f0-b0b3-517177b3b420 req-0f542d83-46eb-4dd5-972c-e0f68e4d945b service nova] Creating event network-changed:3478642f-a083-41dc-8630-0f933d8c0ed9 for instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 on hv-cinder-85600 Sep 09 04:40:47.615590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-470a3125-8bb4-40f0-b0b3-517177b3b420 req-0f542d83-46eb-4dd5-972c-e0f68e4d945b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030422 Sep 09 04:40:47.616183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 130/250] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:47.624817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:47.625812 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 68272816-0af9-49ec-90e0-dbc050690a31] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:47.633197 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:47.633765 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:47.634240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:47.635217 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:47.635527 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:47.636037 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:47.636755 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:47.636921 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:47.643672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:47.644203 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:47.644714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:47.645455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:47.645915 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:47.646341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:47.654002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] HTTP exception thrown: Instance 68272816-0af9-49ec-90e0-dbc050690a31 could not be found. Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Request method failure captured: Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 HTTP/1.1 Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsOyKzjlGhxS4yPiXIWo93TtvsvhJ-LqFKeOefJUa1WxfY98XC-RfAMhQmOjOBTkMvHYX1BObuP0oYTaucOEJTspPW463Dp7NDF2A7w_5k0-9f6IJNgf3aw13N6BKg9aLPV8isOeDJ__HF66YaDS-4RlNOoIFhgppwGBFu-IOBxIIZE Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: ce9bbaae5d5e4e26a6ff2e9d4a1f98c3 Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesActionsTest-1446785134 Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:40:47.655971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}] Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesActionsTest-1446785134 Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: ce9bbaae5d5e4e26a6ff2e9d4a1f98c3 Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesActionsTest-1446785134 Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesActionsTest-1446785134-project Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 64bf0fc10c794dc88efe25cf21ced674 Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesActionsTest-1446785134-project Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 68272816-0af9-49ec-90e0-dbc050690a31 could not be found. Sep 09 04:40:47.657190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '68272816-0af9-49ec-90e0-dbc050690a31'} Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68272816-0af9-49ec-90e0-dbc050690a31 could not be found. Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:40:47.657982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68272816-0af9-49ec-90e0-dbc050690a31 could not be found. Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68272816-0af9-49ec-90e0-dbc050690a31 could not be found. Sep 09 04:40:47.659688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:40:47.660696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Returning 404 to user: Instance 68272816-0af9-49ec-90e0-dbc050690a31 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:40:47.660696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e6af19f9-f096-4f78-a414-9fbb725fda7b tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31" status: 404 len: 111 microversion: 2.1 time: 0.036383 Sep 09 04:40:47.669953 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 121/251] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:47 2022] GET /compute/v2.1/servers/68272816-0af9-49ec-90e0-dbc050690a31 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:40:47.775505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-741761104", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "networks": [{"uuid": "84967da4-2d71-4732-bbc3-ec5f9c426a3c"}]}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:47.831161 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] validate_networks() for [('84967da4-2d71-4732-bbc3-ec5f9c426a3c', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:40:48.010248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:48.018681 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-32520d1f-1901-4217-997c-591fadda6af6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.387931 Sep 09 04:40:48.019291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 131/252] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:47 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:48.275398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:40:48.275819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:40:48.276548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:40:48.276828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:40:48.277333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:40:48.286759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:48.287302 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:48.287727 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:48.288478 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:48.288926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:48.289348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:48.305909 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Getting quotas for project ce9bbaae5d5e4e26a6ff2e9d4a1f98c3. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:40:48.309704 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Getting quotas for user 64bf0fc10c794dc88efe25cf21ced674 and project ce9bbaae5d5e4e26a6ff2e9d4a1f98c3. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:40:48.322288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:40:48.324602 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:40:48.373435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-279584da-582b-43aa-8b4d-2392611d8f6a tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601924 Sep 09 04:40:48.374089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 122/253] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:40:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 04:40:48.384937 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0df4544b-9561-4ec1-896f-ee0641c46657 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:48.385674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0df4544b-9561-4ec1-896f-ee0641c46657 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:48.440119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0df4544b-9561-4ec1-896f-ee0641c46657 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:48.447603 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0df4544b-9561-4ec1-896f-ee0641c46657 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1213 microversion: 2.1 time: 0.066357 Sep 09 04:40:48.448272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 132/254] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:48 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:48.533588 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:48.534204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:48.541265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:48.541746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:48.542197 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:48.542924 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:48.543399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:48.543827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:48.688043 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:48.696843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-09536465-3f21-4bbc-91d0-91520017ae21 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.167110 Sep 09 04:40:48.697427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 123/255] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:48 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:49.041965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:49.042639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:49.063725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:49.063725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:49.063725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:49.063725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:49.064236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:49.064236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:49.206835 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:49.215570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-39e0bbf3-c549-437f-ba94-f51888fc5fbd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.177299 Sep 09 04:40:49.216239 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 133/256] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:49 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:49.470418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:49.471051 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:49.477019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:49.477577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:49.477941 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:49.478991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:49.479546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:49.479999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:49.542427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:49.550127 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ca4dba28-0bc3-4909-b7c9-ee5bd7dcba36 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1265 microversion: 2.1 time: 0.083578 Sep 09 04:40:49.551250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 124/257] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:49 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:49.720738 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:49.721341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:49.727282 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:49.727757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:49.728241 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:49.728919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:49.729367 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:49.729784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:49.877097 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:49.885365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8dab6691-5d49-4f72-91c5-7243987b3a3c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.168751 Sep 09 04:40:49.886164 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 134/258] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:49 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:50.245484 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:50.247002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:50.264601 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:50.265107 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:50.265964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:50.268349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:50.269045 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:50.269662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:50.450644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:50.460716 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-40b95ff5-5062-405b-9651-1180b91dbba1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.219883 Sep 09 04:40:50.461862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 125/259] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:50 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:50.574476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:50.575688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:50.583295 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:50.584030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:50.584651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:50.585666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:50.586299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:50.586973 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:50.751327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:50.767573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-29567849-ce58-4d37-a88f-dd79c9fdb9b6 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.197391 Sep 09 04:40:50.768153 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 135/260] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:50 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:50.923615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:50.924793 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:50.933834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:50.934305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:50.934740 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:50.935476 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:50.935926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:50.936346 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:51.147157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:51.166440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a81a2e21-9869-443e-b885-ef00f6f3f1e2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.260374 Sep 09 04:40:51.167152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 126/261] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:50 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:51.410960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-5b33f858-44d2-43e7-bb4a-f09eae939414 req-897f907a-a5be-4cee-88dd-89655db34b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b441f5-e286-42d4-aba9-b52bf96192d8", "tag": "492efaeb-1db9-4e19-905b-4810de1b7814"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:51.422662 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-5b33f858-44d2-43e7-bb4a-f09eae939414 req-897f907a-a5be-4cee-88dd-89655db34b88 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:51.423588 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-5b33f858-44d2-43e7-bb4a-f09eae939414 req-897f907a-a5be-4cee-88dd-89655db34b88 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:51.424125 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-5b33f858-44d2-43e7-bb4a-f09eae939414 req-897f907a-a5be-4cee-88dd-89655db34b88 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:51.437155 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-5b33f858-44d2-43e7-bb4a-f09eae939414 req-897f907a-a5be-4cee-88dd-89655db34b88 service nova] Creating event network-changed:492efaeb-1db9-4e19-905b-4810de1b7814 for instance 94b441f5-e286-42d4-aba9-b52bf96192d8 on hv-cinder-85600 Sep 09 04:40:51.444264 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-5b33f858-44d2-43e7-bb4a-f09eae939414 req-897f907a-a5be-4cee-88dd-89655db34b88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037652 Sep 09 04:40:51.445222 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 136/262] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:51.485189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:51.485947 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:51.493000 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:51.493608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:51.494143 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:51.494908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:51.495457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:51.495954 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:51.628991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:51.638272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d4cee927-346c-4e68-afb2-127222726bc4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.156636 Sep 09 04:40:51.638885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 127/263] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:51 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:51.792368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:51.793129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:51.799203 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:51.799679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:51.800107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:51.801389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:51.801834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:51.802252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:51.933849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:51.941606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c270a182-3df1-4a51-a7ab-ee11910047de tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.153496 Sep 09 04:40:51.942163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 137/264] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:51 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:52.189907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:52.190438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:52.197271 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:52.197750 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:52.198186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:52.198867 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:52.199342 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:52.199762 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:52.217766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:52.328532 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:52.336749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-eb7bef17-190a-4f19-8826-d92d0079e348 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.151126 Sep 09 04:40:52.337308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 128/265] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:52 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:52.660725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:52.661335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:52.667326 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:52.667836 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:52.668271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:52.668970 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:52.669421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:52.669874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:52.798590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:52.806782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4c7e36d8-920c-4b1e-84f8-600ba079e033 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.149909 Sep 09 04:40:52.807377 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 138/266] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:52 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:52.963938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:52.964546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:52.970879 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:52.971421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:52.971850 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:52.973242 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:52.973687 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:52.974104 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:53.100564 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:53.108118 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0cc12c44-156d-4745-b213-dc56685b4286 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.148135 Sep 09 04:40:53.108673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 129/267] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:52 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:53.359664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:53.360270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:53.366409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:53.366890 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:53.367359 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:53.368046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:53.368502 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:53.368921 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:53.388434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:53.496725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:53.504352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3f9f1fba-218f-482f-b532-63e36c929cd7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.148612 Sep 09 04:40:53.504920 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 139/268] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:53 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:53.830030 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:53.830644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:53.838344 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:53.838833 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:53.839308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:53.840009 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:53.840623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:53.841052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:53.970822 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:53.978558 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3cbcff86-c0f5-45dc-a6d2-b75dc0e00309 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.152321 Sep 09 04:40:53.979167 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 130/269] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:53 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:54.131938 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:54.132565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:54.138419 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:54.138893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:54.139362 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:54.140038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:54.140489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:54.140906 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:54.274292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:54.282612 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c8a46afb-3587-4cb3-b114-9c5aeccae6a1 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.155208 Sep 09 04:40:54.283747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 140/270] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:54 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:54.410504 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-9cd2e501-2523-497f-aa6b-4f9f0bdbe264 req-48ac6d5a-5779-4500-a19a-d1cfe565a23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e092d2-0c03-4288-be1b-f0f2da7f5de2", "name": "network-vif-plugged", "status": "completed", "tag": "3478642f-a083-41dc-8630-0f933d8c0ed9"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:54.422342 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-9cd2e501-2523-497f-aa6b-4f9f0bdbe264 req-48ac6d5a-5779-4500-a19a-d1cfe565a23a service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:54.422893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-9cd2e501-2523-497f-aa6b-4f9f0bdbe264 req-48ac6d5a-5779-4500-a19a-d1cfe565a23a service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:54.423426 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-9cd2e501-2523-497f-aa6b-4f9f0bdbe264 req-48ac6d5a-5779-4500-a19a-d1cfe565a23a service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:54.435327 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-9cd2e501-2523-497f-aa6b-4f9f0bdbe264 req-48ac6d5a-5779-4500-a19a-d1cfe565a23a service nova] Creating event network-vif-plugged:3478642f-a083-41dc-8630-0f933d8c0ed9 for instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 on hv-cinder-85600 Sep 09 04:40:54.444707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-9cd2e501-2523-497f-aa6b-4f9f0bdbe264 req-48ac6d5a-5779-4500-a19a-d1cfe565a23a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038242 Sep 09 04:40:54.445635 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 131/271] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:54.528703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:54.529319 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:54.536346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:54.536838 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:54.537325 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:54.538023 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:54.538476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:54.538901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:54.684497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:54.693244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cc515bc3-e19e-444e-aa78-54081761f623 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.169449 Sep 09 04:40:54.693902 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 141/272] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:54 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:55.002537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:55.003305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:55.009692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:55.010175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:55.010610 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:55.011330 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:55.011785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:55.012215 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:55.147331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:55.155973 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a5cafb5f-827c-481d-b79d-b1b12c5234da tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.158388 Sep 09 04:40:55.156664 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 132/273] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:54 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:55.304808 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:55.305412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:55.311302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:55.311784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:55.312221 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:55.312911 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:55.313365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:55.313797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:55.446160 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:55.453777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3f279eb3-b2eb-488e-88c2-448401251e74 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.152835 Sep 09 04:40:55.454340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:55 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:55.716646 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:55.717252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:55.723115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:55.723594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:55.724027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:55.724710 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:55.725158 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:55.725578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:55.853515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:55.860989 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c7dc3b96-cb33-4066-9795-78bf57dece08 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.148200 Sep 09 04:40:55.861550 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 133/275] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:55 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:56.179448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:56.180063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:56.181904 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:56.187079 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:56.187565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:56.188002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:56.188753 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:56.189206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:56.189886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:56.342581 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:56.351861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8fbd6fa0-63bb-46a7-b2e0-e48ac4861687 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.176877 Sep 09 04:40:56.352437 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 143/276] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:56 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:56.480169 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:56.480787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:56.487216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:56.487719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:56.488145 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:56.488845 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:56.489305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:56.489733 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:56.619874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:56.627442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fd894930-cfd6-4b71-bae0-089b55eda8d9 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.151196 Sep 09 04:40:56.628002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 134/277] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:56 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:56.884664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:56.885363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:56.891281 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:56.891768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:56.892202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:56.892890 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:56.893517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:56.893996 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:57.029683 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:57.037274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-723cfbbf-15d7-45ec-929e-161581bc3fa7 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.156570 Sep 09 04:40:57.037835 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 144/278] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:56 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:57.373697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:57.374222 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:57.380864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:57.381338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:57.381770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:57.382450 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:57.382898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:57.383349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:57.512403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:57.520039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8ea776e2-e65f-488b-852d-ba3ed060f560 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1366 microversion: 2.1 time: 0.150285 Sep 09 04:40:57.520602 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 135/279] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:57 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:57.652130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:57.652737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:57.658567 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:57.659075 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:57.659507 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:57.660672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:57.661134 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:57.662417 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:57.789344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:57.796893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-15854ff6-a641-4dbd-bf53-8ef427a37702 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.149329 Sep 09 04:40:57.797463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 145/280] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:57 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:58.060119 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:58.060728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:58.066865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.067370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.067802 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.068480 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.068927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.069345 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.194390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:58.202072 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0f3fcaef-860a-4dfd-b97d-02d3471ce6ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.145782 Sep 09 04:40:58.202640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 136/281] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:58 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:58.351045 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-ff73a8a0-ca19-4c18-a8db-71ac1b806b54 req-7149551d-4d9d-4f9a-8c9a-edec82a98f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b441f5-e286-42d4-aba9-b52bf96192d8", "name": "network-vif-plugged", "status": "completed", "tag": "492efaeb-1db9-4e19-905b-4810de1b7814"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:40:58.361802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-ff73a8a0-ca19-4c18-a8db-71ac1b806b54 req-7149551d-4d9d-4f9a-8c9a-edec82a98f58 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.362292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-ff73a8a0-ca19-4c18-a8db-71ac1b806b54 req-7149551d-4d9d-4f9a-8c9a-edec82a98f58 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.363575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-ff73a8a0-ca19-4c18-a8db-71ac1b806b54 req-7149551d-4d9d-4f9a-8c9a-edec82a98f58 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.375396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-ff73a8a0-ca19-4c18-a8db-71ac1b806b54 req-7149551d-4d9d-4f9a-8c9a-edec82a98f58 service nova] Creating event network-vif-plugged:492efaeb-1db9-4e19-905b-4810de1b7814 for instance 94b441f5-e286-42d4-aba9-b52bf96192d8 on hv-cinder-85600 Sep 09 04:40:58.380412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-ff73a8a0-ca19-4c18-a8db-71ac1b806b54 req-7149551d-4d9d-4f9a-8c9a-edec82a98f58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 Sep 09 04:40:58.381004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 146/282] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:58.542890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:58.543520 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:58.545495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=4 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:58.546151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=12 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:58.553230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.553712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.554167 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.554864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.555359 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.555806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.694272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:58.703079 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c5988ef4-241a-4200-aa18-04853b1c21c6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1556 microversion: 2.1 time: 0.163995 Sep 09 04:40:58.703653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 137/283] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:58 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:40:58.726663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:58.727344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:58.729502 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=8 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:40:58.735213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.735666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.736157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.736865 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.737487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.737943 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.817063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d07dc917-c3ae-4fb6-b19d-d23afb7edf1d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095120 Sep 09 04:40:58.820937 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:58.821140 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 147/284] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:40:58 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:40:58.821927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:58.828464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.829144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.829748 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:58.830783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:58.831941 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:58.832522 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:59.107711 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:59.116657 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f1cf6c7f-04aa-44da-a74e-10e773d29611 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.299808 Sep 09 04:40:59.117239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 138/285] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:58 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:40:59.225784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:40:59.226422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:40:59.232237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:59.232924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:59.233363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:59.234048 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:40:59.234543 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:40:59.235038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:40:59.464827 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:40:59.473609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5ec2f43c-8d97-450b-b02d-ab24ab98af6a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.252133 Sep 09 04:40:59.474180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 148/286] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:40:59 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:00.142769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:00.143570 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:00.146223 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:00.152768 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:00.153343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:00.153847 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:00.154746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:00.155295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:00.155778 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:00.169299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-3714140e-6883-44c7-93d3-4245e914ebb9 req-c2d04d9a-b2d2-43d4-ad54-5c758c252f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e092d2-0c03-4288-be1b-f0f2da7f5de2", "tag": "3478642f-a083-41dc-8630-0f933d8c0ed9"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:00.181598 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3714140e-6883-44c7-93d3-4245e914ebb9 req-c2d04d9a-b2d2-43d4-ad54-5c758c252f31 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:00.182390 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3714140e-6883-44c7-93d3-4245e914ebb9 req-c2d04d9a-b2d2-43d4-ad54-5c758c252f31 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:00.183074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3714140e-6883-44c7-93d3-4245e914ebb9 req-c2d04d9a-b2d2-43d4-ad54-5c758c252f31 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:00.196806 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-3714140e-6883-44c7-93d3-4245e914ebb9 req-c2d04d9a-b2d2-43d4-ad54-5c758c252f31 service nova] Creating event network-changed:3478642f-a083-41dc-8630-0f933d8c0ed9 for instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 on hv-cinder-85600 Sep 09 04:41:00.202028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-3714140e-6883-44c7-93d3-4245e914ebb9 req-c2d04d9a-b2d2-43d4-ad54-5c758c252f31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036122 Sep 09 04:41:00.202850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 149/287] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:00.294388 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:00.302807 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5816cbd3-9933-4ac9-b918-f029e0434c95 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1313 microversion: 2.1 time: 0.166318 Sep 09 04:41:00.303408 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 139/288] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:00 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:00.497411 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:00.498204 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:00.504877 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:00.505370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:00.505862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:00.506577 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:00.507072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:00.507536 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:00.649772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:00.657413 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-aa4e582a-bed3-49fa-995d-8846e0e912c8 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.164798 Sep 09 04:41:00.657974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 150/289] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:00 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:01.326897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:01.328193 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:01.336821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:01.337322 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:01.337762 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:01.338475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:01.338925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:01.339375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:01.477478 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:01.485249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-16539519-39ba-4219-bba0-c882aefb48a4 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1498 microversion: 2.1 time: 0.162290 Sep 09 04:41:01.485834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 140/290] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:01 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:01.681202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:01.681813 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:01.687691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:01.688458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:01.688897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:01.689836 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:01.690287 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:01.690721 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:01.836517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:01.845445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-92e24b77-0eee-4a16-acfd-89b37e12e675 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.168353 Sep 09 04:41:01.846045 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 151/291] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:01 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:02.153247 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:02.153750 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:02.161323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:02.161809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:02.162241 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:02.162960 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:02.163399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:02.163820 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:02.188928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:41:02.266459 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b5f2447e-d073-434e-b0d8-a75d2a16e974 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 204 len: 0 microversion: 2.1 time: 0.117133 Sep 09 04:41:02.267217 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 141/292] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:41:02 2022] DELETE /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:41:02.275141 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:02.275746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:02.281635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:02.282109 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:02.282539 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:02.283245 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:02.283696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:02.284115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:02.411646 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:02.419733 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d2ab4683-0e77-4cd3-9e1a-cdc760fee10d tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1504 microversion: 2.1 time: 0.148388 Sep 09 04:41:02.420303 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 152/293] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:02 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:02.868978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:02.869611 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:02.875452 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:02.875932 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:02.876360 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:02.877292 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:02.877744 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:02.878645 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:03.005423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:03.013200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-55583128-55f5-4aba-9a50-6f94c66457f9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.148497 Sep 09 04:41:03.013791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 142/294] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:02 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:03.443430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:03.443958 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:03.450108 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:03.450690 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:03.451164 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:03.451957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:03.452457 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:03.452887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:03.583786 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:03.591472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-eefd8839-6540-4fad-9b3d-9f5d49829e39 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1504 microversion: 2.1 time: 0.152441 Sep 09 04:41:03.592043 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 153/295] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:03 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:04.037877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:04.038484 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:04.045129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:04.045609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:04.046044 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:04.046735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:04.047219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:04.047648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:04.175373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:04.183158 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d6bf6b02-7d3e-4c01-8672-b6660c9b8c65 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.149683 Sep 09 04:41:04.183721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 143/296] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:04 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:04.614730 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:04.616180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:04.622132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:04.622607 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:04.623072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:04.623757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:04.624204 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:04.624637 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:04.757133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:04.764753 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-56215602-a2ad-4fbf-9356-54c010c76ef5 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1504 microversion: 2.1 time: 0.154013 Sep 09 04:41:04.765312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 154/297] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:04 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:05.206403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:05.206961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:05.213643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.214133 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.214569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.215291 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.215751 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.216185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.220168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:05.349688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:05.358405 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-cc0d01c5-906d-4d24-8e1d-8feff5b7e4f6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1500 microversion: 2.1 time: 0.156527 Sep 09 04:41:05.358992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 144/298] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:05 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:05.383025 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "672e85e9-05c6-45ec-a717-2296dbfce1b1"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:05.385666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:05.392227 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.392772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.393209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.393910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.394364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.394789 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.419112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] HTTP exception thrown: Cannot 'attach_volume' instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f while it is in vm_state rescued Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Request method failure captured: Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: POST /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f/os-volume_attachments HTTP/1.1 Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 74 Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNm00-OuUMYpqLU-J1jDk2uHbHSIG7fwOGXAsJizzmC3IGtmdzcTkbUTGdBfwF-GNLFmqjzV-A2UZ7VM-Z2a63MqouKGWM-O5fUuh8a41_gduvl7Vjy57JW6yHtIoeX_3BtvBxjBtfT_Pjl5GxVSgPjQ2GfGF3bJAgmpGxvvWFkjHg Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:41:05.420844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}] Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: d3c29c23d7524adf9c5a3271224ac8d3 Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {"volumeAttachment": {"volumeId": "672e85e9-05c6-45ec-a717-2296dbfce1b1"}} Sep 09 04:41:05.422339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Cannot 'attach_volume' instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f while it is in vm_state rescued Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'server_id': '86b22e86-a3f6-4e3d-bb20-2ef261176f1f', 'body': {'volumeAttachment': {'volumeId': '672e85e9-05c6-45ec-a717-2296dbfce1b1'}}} Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:41:05.423309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f while it is in vm_state rescued Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:41:05.424881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:41:05.426609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:41:05.426609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:41:05.426609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f while it is in vm_state rescued Sep 09 04:41:05.426609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:41:05.426609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Returning 409 to user: Cannot 'attach_volume' instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f while it is in vm_state rescued {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:41:05.426609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fc154063-6440-49c3-8800-450ad201d43b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045864 Sep 09 04:41:05.426609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 155/299] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:41:05 2022] POST /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 04:41:05.431811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:05.432758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:05.439216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.439972 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.440408 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.441117 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.441574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.442030 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.509445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-52e72447-dc49-4462-9b42-3e94548b20a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f/action" status: 202 len: 0 microversion: 2.1 time: 0.081534 Sep 09 04:41:05.509995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 145/300] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:41:05 2022] POST /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:41:05.518131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:05.518774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:05.525280 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.525759 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.526194 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.526878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.527361 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.527787 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.660628 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:05.668397 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d073f0d6-1e27-4f94-a706-e303d57f2243 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1508 microversion: 2.1 time: 0.154124 Sep 09 04:41:05.668979 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 156/301] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:05 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:05.792164 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:05.792818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:05.799542 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.800129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.800575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.801282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:05.801735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:05.802192 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:05.939888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:05.948115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-96820955-5dd0-4fd6-bc1b-89102b0ddb47 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1504 microversion: 2.1 time: 0.164315 Sep 09 04:41:05.948686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 146/302] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:05 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:06.440808 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-63b76393-d536-45b7-86a7-ded2afde649f req-9088de81-fda6-4aa8-ac9a-201a96e69010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b441f5-e286-42d4-aba9-b52bf96192d8", "name": "network-vif-deleted", "tag": "492efaeb-1db9-4e19-905b-4810de1b7814"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:06.455364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-63b76393-d536-45b7-86a7-ded2afde649f req-9088de81-fda6-4aa8-ac9a-201a96e69010 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:06.455861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-63b76393-d536-45b7-86a7-ded2afde649f req-9088de81-fda6-4aa8-ac9a-201a96e69010 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:06.456372 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-63b76393-d536-45b7-86a7-ded2afde649f req-9088de81-fda6-4aa8-ac9a-201a96e69010 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:06.478631 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-63b76393-d536-45b7-86a7-ded2afde649f req-9088de81-fda6-4aa8-ac9a-201a96e69010 service nova] Creating event network-vif-deleted:492efaeb-1db9-4e19-905b-4810de1b7814 for instance 94b441f5-e286-42d4-aba9-b52bf96192d8 on hv-cinder-85600 Sep 09 04:41:06.484414 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-63b76393-d536-45b7-86a7-ded2afde649f req-9088de81-fda6-4aa8-ac9a-201a96e69010 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053452 Sep 09 04:41:06.485593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 157/303] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:06.691675 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:06.692266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:06.699453 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:06.700013 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:06.700521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:06.701324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:06.701849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:06.702354 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:06.839179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:06.846939 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5455bd57-95cd-450e-92e8-13ee8adaddca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1508 microversion: 2.1 time: 0.159395 Sep 09 04:41:06.847551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 147/304] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:06 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:06.971370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:06.972074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:06.978174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:06.978658 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:06.979132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:06.979830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:06.980287 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:06.980712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:07.015311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:07.015803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:07.016277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:07.016723 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lazy-loading 'fault' on Instance uuid 94b441f5-e286-42d4-aba9-b52bf96192d8 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:41:07.023412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:07.067441 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:07.075177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fc8fbdfc-bc60-49f6-a47a-fb13a4dc8088 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1303 microversion: 2.1 time: 0.108122 Sep 09 04:41:07.075733 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 158/305] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:06 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:07.870574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:07.871162 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:07.877552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:07.878029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:07.878464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:07.879188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:07.879643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:07.880066 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:08.006811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:08.015849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-356b0dc9-0dd0-45ab-ab6d-08e85c45279e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1508 microversion: 2.1 time: 0.149341 Sep 09 04:41:08.016890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 148/306] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:07 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:08.097719 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:08.098328 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:08.104851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:08.105338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:08.105777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:08.106467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:08.106923 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:08.107370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:08.140020 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:08.140412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:08.140848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:08.141297 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lazy-loading 'fault' on Instance uuid 94b441f5-e286-42d4-aba9-b52bf96192d8 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:41:08.185415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:08.193324 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e5f01c25-26d8-4781-b36f-4cc1afc9f184 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1303 microversion: 2.1 time: 0.099532 Sep 09 04:41:08.193881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 159/307] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:08 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:08.524882 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:08.525388 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:08.531402 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:08.531885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:08.532320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:08.533022 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:08.533465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:08.533965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:08.557667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ff6f6830-4b3b-4fd8-be7d-2cdfe5473484 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/ips" status: 200 len: 147 microversion: 2.1 time: 0.037251 Sep 09 04:41:08.558233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 149/308] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:41:08 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:09.040069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:09.040699 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:09.046718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:09.047234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:09.047668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:09.048353 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:09.048800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:09.049225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:09.216738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:09.217354 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:09.224319 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:09.224805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:09.225784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:09.226481 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:09.226968 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:09.227379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:09.250186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:09.262894 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1fdda06e-2a5e-45af-aee6-1d0a8cdef27d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1508 microversion: 2.1 time: 0.226924 Sep 09 04:41:09.263875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 160/309] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:09 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:09.272071 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:09.272650 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:09.273157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:09.274157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lazy-loading 'fault' on Instance uuid 94b441f5-e286-42d4-aba9-b52bf96192d8 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:41:09.315974 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf0fc10c794dc88efe25cf21ced674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9bbaae5d5e4e26a6ff2e9d4a1f98c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:09.324138 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3a95a5af-dd85-4d2f-96ef-ee001a19f765 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 200 len: 1303 microversion: 2.1 time: 0.111293 Sep 09 04:41:09.324698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 150/310] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:09 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:10.285801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:10.286526 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:10.293232 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:10.293718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:10.294149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:10.294848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:10.295344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:10.295767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:10.348423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:10.349032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] [instance: 94b441f5-e286-42d4-aba9-b52bf96192d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:10.356190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:10.356703 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:10.357138 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:10.357832 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:10.358283 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:10.358702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:10.372498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] HTTP exception thrown: Instance 94b441f5-e286-42d4-aba9-b52bf96192d8 could not be found. Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Request method failure captured: Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 HTTP/1.1 Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsOyKzjlGhxS4yPiXIWo93TtvsvhJ-LqFKeOefJUa1WxfY98XC-RfAMhQmOjOBTkMvHYX1BObuP0oYTaucOEJTspPW463Dp7NDF2A7w_5k0-9f6IJNgf3aw13N6BKg9aLPV8isOeDJ__HF66YaDS-4RlNOoIFhgppwGBFu-IOBxIIZE Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: ce9bbaae5d5e4e26a6ff2e9d4a1f98c3 Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesActionsTest-1446785134 Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:41:10.374276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce9bbaae5d5e4e26a6ff2e9d4a1f98c3"}]}] Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesActionsTest-1446785134 Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: ce9bbaae5d5e4e26a6ff2e9d4a1f98c3 Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesActionsTest-1446785134 Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesActionsTest-1446785134-project Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 64bf0fc10c794dc88efe25cf21ced674 Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesActionsTest-1446785134-project Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 94b441f5-e286-42d4-aba9-b52bf96192d8 could not be found. Sep 09 04:41:10.375794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '94b441f5-e286-42d4-aba9-b52bf96192d8'} Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b441f5-e286-42d4-aba9-b52bf96192d8 could not be found. Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:41:10.376594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b441f5-e286-42d4-aba9-b52bf96192d8 could not be found. Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b441f5-e286-42d4-aba9-b52bf96192d8 could not be found. Sep 09 04:41:10.378086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:41:10.379834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] Returning 404 to user: Instance 94b441f5-e286-42d4-aba9-b52bf96192d8 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:41:10.379834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-83f70c1f-bbfb-4046-b149-9b559a7488b8 tempest-VolumesActionsTest-1446785134 tempest-VolumesActionsTest-1446785134-project] 10.222.0.20 "GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8" status: 404 len: 111 microversion: 2.1 time: 0.031183 Sep 09 04:41:10.379834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 151/311] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:10 2022] GET /compute/v2.1/servers/94b441f5-e286-42d4-aba9-b52bf96192d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 04:41:10.430713 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:10.438673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-060e7eda-7193-4d28-ba07-eecb7c15a929 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1514 microversion: 2.1 time: 0.156901 Sep 09 04:41:10.439256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 161/312] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:10 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:11.803473 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:11.803979 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:11.811077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:11.811565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:11.812002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:11.812696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:11.813321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:11.813746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:11.846902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9b266db9-8fea-43ac-ad08-a4e806f49f24 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/ips" status: 200 len: 151 microversion: 2.20 time: 0.040134 Sep 09 04:41:11.846902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 152/313] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Sep 9 04:41:11 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:41:11.862438 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-58c32220-48ae-4a68-a8b2-41b302959670 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'create', calling method: .version_select at 0x7f43faedce50>, body: {"keypair": {"name": "tempest-keypair-689407732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC84lhMFdJSaVMRmM4RBuNtTquQLQqbSHmnf1OrdWbDpnBAee8KYpyc04PQlOFVXffNuAv9NhZWLQPl0qv9Inu23pVjzA7EykCYeAhOW6Q1WoE4cm32voQgmLfxaEFmsSQ=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:11.878630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-58c32220-48ae-4a68-a8b2-41b302959670 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:41:11.883078 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-58c32220-48ae-4a68-a8b2-41b302959670 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for user d3c29c23d7524adf9c5a3271224ac8d3 and project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:41:11.907120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-58c32220-48ae-4a68-a8b2-41b302959670 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048281 Sep 09 04:41:11.908845 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 162/314] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:41:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:13.185699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-428968871", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c260770-d4b1-4e02-bd09-9b1833989c1e"}], "security_groups": [{"name": "tempest-securitygroup--967198297"}], "key_name": "tempest-keypair-689407732", "user_data": "}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:13.304743 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] validate_networks() for [('1c260770-d4b1-4e02-bd09-9b1833989c1e', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:41:13.669786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:41:13.670205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:41:13.670672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:41:13.671110 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:41:13.671526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:41:13.680115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:13.680620 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:13.681064 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:13.681786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:13.682233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:13.682653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:13.699139 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:41:13.702916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Getting quotas for user d3c29c23d7524adf9c5a3271224ac8d3 and project 1d203c97242044fb8bf29bdc461e2efd. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:41:13.714220 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:41:13.716505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:41:13.761463 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5ab77656-e89d-4f84-9fd1-31e1aa9e8bb5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.580517 Sep 09 04:41:13.761955 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 153/315] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:41:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:41:13.773115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a0a4dae0-5139-401b-a271-11cbbfac7eb2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:13.773728 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a0a4dae0-5139-401b-a271-11cbbfac7eb2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:13.826643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a0a4dae0-5139-401b-a271-11cbbfac7eb2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:13.833459 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a0a4dae0-5139-401b-a271-11cbbfac7eb2 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1244 microversion: 2.1 time: 0.064296 Sep 09 04:41:13.834020 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 163/316] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:13 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1244 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:14.857691 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:14.858310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:14.865116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:14.865607 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:14.866232 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:14.866966 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:14.867421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:14.867910 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:14.936389 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:14.944568 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-94c225f5-f4ce-4bdb-9ddd-20d889805aa6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1296 microversion: 2.1 time: 0.091175 Sep 09 04:41:14.945128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 154/317] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:14 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:15.753410 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0da1d0b-6850-4986-b2bc-0877968a563a"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:15.757041 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:15.764912 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:15.765407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:15.765963 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:15.766675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:15.767172 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:15.768120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:15.967544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:15.968321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:15.975129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:15.975725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:15.976198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:15.977095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:15.977554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:15.978181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:16.091908 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-32f04274-a452-4a90-a782-10f708f0293d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342311 Sep 09 04:41:16.098158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 164/318] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:41:15 2022] POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:16.100815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:16.112934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-39a67cc9-d524-4d0d-b574-32e70e5c7293 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1302 microversion: 2.1 time: 0.149626 Sep 09 04:41:16.114317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 155/319] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:15 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:17.106152 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-97dcf7a8-8e4d-412c-a604-0794b68a71bf req-322fc43a-dbf6-4aec-9376-f5150ffb58e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b697ec-4fe5-4eb3-95c9-6890c141915b", "tag": "e2bb2333-df06-4b43-a41b-37e81ef693cb"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:17.132738 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-97dcf7a8-8e4d-412c-a604-0794b68a71bf req-322fc43a-dbf6-4aec-9376-f5150ffb58e6 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:17.133711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-97dcf7a8-8e4d-412c-a604-0794b68a71bf req-322fc43a-dbf6-4aec-9376-f5150ffb58e6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:17.134443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-97dcf7a8-8e4d-412c-a604-0794b68a71bf req-322fc43a-dbf6-4aec-9376-f5150ffb58e6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:17.142111 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:17.144085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:17.146752 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-97dcf7a8-8e4d-412c-a604-0794b68a71bf req-322fc43a-dbf6-4aec-9376-f5150ffb58e6 service nova] Creating event network-changed:e2bb2333-df06-4b43-a41b-37e81ef693cb for instance 81b697ec-4fe5-4eb3-95c9-6890c141915b on hv-cinder-85600 Sep 09 04:41:17.153097 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:17.153983 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-97dcf7a8-8e4d-412c-a604-0794b68a71bf req-322fc43a-dbf6-4aec-9376-f5150ffb58e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052281 Sep 09 04:41:17.155015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 165/320] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:41:17.155424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:17.155975 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:17.156916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:17.157959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:17.158595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:17.200312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:17.201326 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:17.207987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:17.208553 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:17.209222 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:17.210213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:17.210886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:17.212365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:17.253901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lazy-loading 'flavor' on Instance uuid 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:41:17.378982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:17.401351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-716c238f-596e-4a3d-b5e5-f0e9e45ab57b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1369 microversion: 2.1 time: 0.263752 Sep 09 04:41:17.406725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 156/321] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:17 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1369 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:17.624302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c1a84ccd-9027-4375-90c9-1038507fb2c3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/action" status: 202 len: 0 microversion: 2.20 time: 0.436628 Sep 09 04:41:17.624958 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 166/322] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 04:41:17 2022] POST /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 04:41:17.640549 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:17.641872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:17.655631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:17.657632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:17.658476 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:17.659643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:17.660328 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:17.660916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:17.846503 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:17.859125 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:17.861603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:17.863866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-38df692c-af55-4ce6-9bae-221a8bd2dd8d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.232278 Sep 09 04:41:17.865275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 157/323] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:17 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:18.432942 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:18.433634 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:18.449553 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:18.450604 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:18.451967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:18.453013 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:18.453660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:18.454237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:18.673686 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:18.684814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a9ce797b-14c7-45fe-b0b4-6579713670c3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1369 microversion: 2.1 time: 0.257141 Sep 09 04:41:18.685764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 167/324] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:18 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1369 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:18.892306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:18.893199 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:18.901678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:18.902752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:18.903337 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:18.904283 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:18.904865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:18.905290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:19.063276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:19.072770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:19.074632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:19.075988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8d3107e2-db04-4454-89aa-fe2d41550f4b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.187925 Sep 09 04:41:19.077099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 158/325] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:18 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:19.709416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:19.710028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:19.720719 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:19.721445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:19.722090 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:19.723102 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:19.723725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:19.724333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:19.964550 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:19.980645 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3879835b-bf9d-46c2-b8cd-d25e93fa8426 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1369 microversion: 2.1 time: 0.275033 Sep 09 04:41:19.981802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 168/326] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:19 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1369 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:20.102041 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:20.103255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:20.111167 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:20.111669 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:20.112143 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:20.112857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:20.113325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:20.114006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:20.278450 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:20.290397 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:20.291866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:20.293419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-cf1ad7df-bc23-45c0-ba79-391a8a80f528 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.195503 Sep 09 04:41:20.294744 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 159/327] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:20 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:21.006769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:21.013025 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:21.022103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:21.022815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:21.023283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:21.023999 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:21.025039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:21.025410 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:21.165638 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:21.175489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2ae84e12-f80a-4925-9fb3-4718599fba4e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1369 microversion: 2.1 time: 0.174628 Sep 09 04:41:21.177115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 169/328] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:20 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:21.322406 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:21.323592 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:21.330717 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:21.331411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:21.332006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:21.332868 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:21.333316 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:21.333906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:21.548801 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:21.569899 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:21.572089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:21.573334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-05f4d271-ed2a-47b4-8c73-97371e814e88 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.255360 Sep 09 04:41:21.573890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 160/329] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:21 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:22.200902 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:22.201503 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:22.208363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:22.208840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:22.209474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:22.210168 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:22.210611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:22.211253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:22.619504 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:22.620722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:22.630039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:22.633283 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:22.635250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:22.636265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:22.639577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:22.640332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:22.685441 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:22.698327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:22.718847 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-556d16a3-9e2e-41d2-81f5-67c88ed87261 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1369 microversion: 2.1 time: 0.521385 Sep 09 04:41:22.721257 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 170/330] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:22 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1369 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:22.758533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-cd5741d3-c8b4-45b8-a132-33b87e4f2e07 req-f346a973-4578-409b-ba75-d527fc7dd459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b697ec-4fe5-4eb3-95c9-6890c141915b", "name": "network-vif-plugged", "status": "completed", "tag": "e2bb2333-df06-4b43-a41b-37e81ef693cb"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:22.787763 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cd5741d3-c8b4-45b8-a132-33b87e4f2e07 req-f346a973-4578-409b-ba75-d527fc7dd459 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:22.791016 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cd5741d3-c8b4-45b8-a132-33b87e4f2e07 req-f346a973-4578-409b-ba75-d527fc7dd459 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:22.791547 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cd5741d3-c8b4-45b8-a132-33b87e4f2e07 req-f346a973-4578-409b-ba75-d527fc7dd459 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:22.814490 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-cd5741d3-c8b4-45b8-a132-33b87e4f2e07 req-f346a973-4578-409b-ba75-d527fc7dd459 service nova] Creating event network-vif-plugged:e2bb2333-df06-4b43-a41b-37e81ef693cb for instance 81b697ec-4fe5-4eb3-95c9-6890c141915b on hv-cinder-85600 Sep 09 04:41:22.827351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-cd5741d3-c8b4-45b8-a132-33b87e4f2e07 req-f346a973-4578-409b-ba75-d527fc7dd459 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103568 Sep 09 04:41:22.828109 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 171/331] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:22.853625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:22.863019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:22.865084 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:22.866829 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-16dec20a-e197-4f75-bef8-02f24903c2ba tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.252130 Sep 09 04:41:22.867579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 161/332] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:22 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:41:23.753026 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:23.754505 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:23.761890 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:23.762905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:23.776629 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:23.777824 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:23.779821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:23.780468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:23.835383 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=6 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:23.865555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-27359dad-100c-4920-80c6-5c19af10ba2f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:23.871661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:23.872406 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=6 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:23.874300 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-27359dad-100c-4920-80c6-5c19af10ba2f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:23.875164 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-27359dad-100c-4920-80c6-5c19af10ba2f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:23.876061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-27359dad-100c-4920-80c6-5c19af10ba2f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:23.951880 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-27359dad-100c-4920-80c6-5c19af10ba2f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Going to try to stop instance {{(pid=127437) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 04:41:23.960203 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:23.973962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9d2dc84b-916c-44cc-9c07-5e54a48fde45 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1369 microversion: 2.1 time: 0.226766 Sep 09 04:41:23.974587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 172/333] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:23 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:23.981010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:23.981627 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:23.989590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:23.990136 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:23.991205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:23.992165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:23.993302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:23.993891 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:24.043420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-27359dad-100c-4920-80c6-5c19af10ba2f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action" status: 202 len: 0 microversion: 2.1 time: 0.181771 Sep 09 04:41:24.044713 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 162/334] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:41:23 2022] POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 04:41:24.056373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:24.057579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:24.065490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:24.079626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:24.081083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:24.084117 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:24.087232 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:24.088174 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:24.243284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:24.252885 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:24.254596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:24.255955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2f04ac69-34e8-402a-9744-a009b4006f85 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.280161 Sep 09 04:41:24.256749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 173/335] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:23 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:24.286588 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:24.296842 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d9a0cb1d-e2d0-49ad-9c3e-bca675c5d53f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.247019 Sep 09 04:41:24.297617 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 163/336] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:24 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:24.997629 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:24.998318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:25.004965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:25.005446 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:25.005913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:25.006630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:25.007270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:25.007851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:25.185767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:25.190535 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:25.198349 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-993a83b6-d215-4641-869f-c229edad7c3a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1369 microversion: 2.1 time: 0.205382 Sep 09 04:41:25.199672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 174/337] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:24 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:25.282859 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:25.283937 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:25.293442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:25.294539 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:25.295171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:25.296055 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:25.296621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:25.297102 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:25.322478 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:25.323497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:25.333913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:25.334867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:25.335562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:25.336814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:25.338099 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:25.338741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:25.617020 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:25.621436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:25.628034 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9d45a648-a033-47e3-b7bc-5ba6a9ec690a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.310495 Sep 09 04:41:25.628830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 175/338] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:25 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:25.631039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:25.632487 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:25.636807 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-865d7ca2-e004-4ad8-9b4b-766f8cbf4814 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.358435 Sep 09 04:41:25.648479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 164/339] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:25 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:26.221691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:26.222301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:26.224732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:26.230561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.231307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.231907 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:26.232867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.233471 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.234044 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:26.376460 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:26.387552 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-aebac873-a738-4cf2-8187-9d1eb9d4e778 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1562 microversion: 2.1 time: 0.169725 Sep 09 04:41:26.388372 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 176/340] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:26 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:26.410162 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:26.410705 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:26.417588 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.418268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.418866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:26.419752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.420209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.420911 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:26.506708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-12daf934-8fa0-4f88-a71f-729f6694ba6b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100357 Sep 09 04:41:26.507519 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 165/341] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:41:26 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:26.654862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:26.655616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:26.667031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:26.670623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:26.672911 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.673427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.673871 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:26.674595 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.675080 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.675509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:26.682745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.682745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.683131 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:26.684631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:26.685347 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:26.685955 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:27.084734 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:27.099925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:27.101381 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:27.115516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-15e9d553-3c6f-400b-a158-0e4c2dd3d73d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.440508 Sep 09 04:41:27.116390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 166/342] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:26 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:27.144446 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:27.155969 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9d9e8ce0-57ea-4194-b6d0-8d21c13b4f25 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.503663 Sep 09 04:41:27.156864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 177/343] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:26 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:27.923519 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-66fa92e9-fb80-4523-83a1-393799d0e64e req-ea715c4c-19fe-43e3-a8e7-c15ebd2a6039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b697ec-4fe5-4eb3-95c9-6890c141915b", "tag": "e2bb2333-df06-4b43-a41b-37e81ef693cb"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:27.934585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-66fa92e9-fb80-4523-83a1-393799d0e64e req-ea715c4c-19fe-43e3-a8e7-c15ebd2a6039 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:27.935331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-66fa92e9-fb80-4523-83a1-393799d0e64e req-ea715c4c-19fe-43e3-a8e7-c15ebd2a6039 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:27.935920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-66fa92e9-fb80-4523-83a1-393799d0e64e req-ea715c4c-19fe-43e3-a8e7-c15ebd2a6039 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:27.950145 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-66fa92e9-fb80-4523-83a1-393799d0e64e req-ea715c4c-19fe-43e3-a8e7-c15ebd2a6039 service nova] Creating event network-changed:e2bb2333-df06-4b43-a41b-37e81ef693cb for instance 81b697ec-4fe5-4eb3-95c9-6890c141915b on hv-cinder-85600 Sep 09 04:41:27.955615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-66fa92e9-fb80-4523-83a1-393799d0e64e req-ea715c4c-19fe-43e3-a8e7-c15ebd2a6039 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035551 Sep 09 04:41:27.956651 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 167/344] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:41:28.141040 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:28.141796 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:28.151127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:28.154189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:28.154616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:28.157236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:28.157985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:28.158839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:28.184811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:28.185866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:28.201422 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:28.204398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:28.204866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:28.209324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:28.210012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:28.212692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:28.676034 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:28.706013 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:28.708312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:28.712531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cb685d24-cbc2-4ff2-9672-2eec58c394c9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.574295 Sep 09 04:41:28.713682 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 178/345] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:28 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:28.729026 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:28.754018 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ce1623d0-d805-4948-b25c-46c5b1382abe tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.569537 Sep 09 04:41:28.766991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 168/346] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:28 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:29.744815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:29.745430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:29.751884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:29.752371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:29.752846 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:29.753542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:29.753997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:29.754423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:29.778268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:29.779182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:29.786035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:29.786758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:29.787303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:29.788201 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:29.788847 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:29.789281 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:29.967869 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:29.974897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:29.977587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:29.979808 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:29.981065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-aa0c6c1a-0310-460b-9d25-61945d0d5e7b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.240308 Sep 09 04:41:29.985551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-31413b01-dfe7-4d40-92c9-e96811fd0c95 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.211337 Sep 09 04:41:29.991538 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 179/347] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:29 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:29.999507 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 169/348] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:29 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:31.011968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:31.014219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:31.015284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:31.017357 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:31.028645 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:31.030062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:31.030554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:31.031018 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:31.031732 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:31.032189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:31.034737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:31.035269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:31.035682 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:31.036569 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:31.037176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:31.037752 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:31.038251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:31.260496 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:31.269362 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:31.270754 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:31.270887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:31.272007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cd09020a-514c-446b-bf20-02af0fee298f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.267025 Sep 09 04:41:31.275053 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 180/349] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:31 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:41:31.281425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-33bf0268-c340-4397-8087-555d442f6c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.275149 Sep 09 04:41:31.282112 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 170/350] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:31 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:32.297649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:32.298253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:32.305818 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:32.306209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:32.306959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:32.307249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:32.307860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:32.308719 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:32.309324 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:32.309899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:32.322715 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:32.323757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:32.324465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:32.325644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:32.326713 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:32.327365 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:32.599195 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:32.609871 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-98421455-e649-41e4-9f26-9e199404277b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.308945 Sep 09 04:41:32.611647 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 171/351] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:32 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:32.616011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:32.625085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:32.626735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:32.628098 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d6a39ce7-ede6-4325-a51e-fac20ffa1fdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.334326 Sep 09 04:41:32.628655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 181/352] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:32 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:33.635590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:33.636835 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:33.657124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:33.658346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:33.672218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:33.675491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:33.677189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:33.677835 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:33.678706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:33.684119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:33.684809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:33.685488 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:33.686410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:33.687078 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:33.687736 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:33.692913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:34.231640 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:34.251077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:34.252558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:34.266663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e2512317-9438-4536-8bea-082b13990ca4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.601856 Sep 09 04:41:34.283073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 182/353] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:33 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:34.288994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:34.312967 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-daf96a44-4bb8-4577-a189-98952d565527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.680932 Sep 09 04:41:34.313674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 172/354] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:33 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:35.295575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:35.296187 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:35.302305 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:35.302812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:35.303268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:35.303969 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:35.304422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:35.304850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:35.337514 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:35.338213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:35.344795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:35.345764 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:35.346422 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:35.347457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:35.348147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:35.348770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:35.499942 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:35.508657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:35.510128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:35.511484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e733ae76-b880-4d31-a991-222ff0147788 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.220751 Sep 09 04:41:35.512705 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 183/355] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:35 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:35.531523 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:35.547442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-358771eb-e389-4114-9978-3185ec98eaa2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.213641 Sep 09 04:41:35.548218 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 173/356] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:35 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:36.548832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:36.549609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:36.556492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:36.556946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:36.557386 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:36.558091 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:36.558597 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:36.558971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:36.572804 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:36.574387 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:36.581954 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:36.582663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:36.583273 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:36.584072 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:36.584551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:36.585278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:36.785570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:36.789649 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:36.793947 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:36.795440 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:36.796611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9911dd6e-579c-4cad-8a1c-eadd62401672 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.252405 Sep 09 04:41:36.797365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 184/357] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:36 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:36.798129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-876ea749-f34e-4ff2-8a69-534430bc8d2a tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.230471 Sep 09 04:41:36.798698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 174/358] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:36 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:41:37.824104 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:37.824738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:37.831399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:37.832022 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:37.835603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:37.836776 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:37.837343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:37.838061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:37.838516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:37.839045 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:37.839590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:37.839936 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:37.840388 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:37.841103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:37.841622 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:37.842233 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:38.123925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:38.130209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:38.132472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9b200975-dc2c-40a0-a6b8-7be1b96bb39f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.312811 Sep 09 04:41:38.133539 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 175/359] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:37 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:38.154695 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:38.156590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:38.158279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-93847677-1945-4d75-8775-93ccc73e5add tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.340362 Sep 09 04:41:38.159014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 185/360] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:37 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:39.157602 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:39.158209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:39.165214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:39.165683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:39.166114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:39.166791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:39.167268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:39.167686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:39.186884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:39.187549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:39.196053 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:39.196546 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:39.196989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:39.197696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:39.198151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:39.198587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:39.369563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:39.373597 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:39.377828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6b8ba279-b09b-4786-8663-407e5bef5856 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1723 microversion: 2.1 time: 0.224008 Sep 09 04:41:39.378406 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 176/361] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:39 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:39.381635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:39.383796 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:39.384742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-31172d8a-7d2d-4636-9afc-a7f872c96471 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1744 microversion: 2.20 time: 0.202181 Sep 09 04:41:39.385291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 186/362] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:39 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:41:40.402114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:40.402803 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:40.409291 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:40.409781 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:40.410227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:40.410350 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:40.410854 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:40.411003 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:40.411393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:40.411819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:40.418491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:40.419003 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:40.419451 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:40.420154 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:40.420654 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:40.421149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:40.631250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:40.634417 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:40.643266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a3e74460-73cd-4358-bf0a-a07a9ff98c96 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1700 microversion: 2.1 time: 0.245439 Sep 09 04:41:40.647286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:40.649420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:40.649623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 177/363] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:40 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1700 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:40.651118 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c0106805-86e9-47cc-af5e-20c65d5e0f21 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1744 microversion: 2.20 time: 0.244908 Sep 09 04:41:40.651668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 187/364] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:40 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1744 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:41:40.668430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bb737f93-1b8e-463f-ae0f-ba4e6b4bc7dd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:40.675254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb737f93-1b8e-463f-ae0f-ba4e6b4bc7dd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:40.675934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb737f93-1b8e-463f-ae0f-ba4e6b4bc7dd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:40.676382 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb737f93-1b8e-463f-ae0f-ba4e6b4bc7dd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:40.680060 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:40.701520 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bb737f93-1b8e-463f-ae0f-ba4e6b4bc7dd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Going to try to start instance {{(pid=127437) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 04:41:40.755626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bb737f93-1b8e-463f-ae0f-ba4e6b4bc7dd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action" status: 202 len: 0 microversion: 2.1 time: 0.091131 Sep 09 04:41:40.759159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 178/365] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:41:40 2022] POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:41:40.764452 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:40.765342 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:40.772850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:40.774488 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:40.775228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:40.776195 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:40.777217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:40.777907 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:40.972226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:40.983192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c3234ed3-299e-45c5-99a3-4d8b6aaee6c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1709 microversion: 2.1 time: 0.222499 Sep 09 04:41:40.983772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 188/366] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:40 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1709 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:41.678309 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:41.679128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:41.685736 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:41.686209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:41.686637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:41.687347 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:41.687795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:41.688207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:41.817796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:41.826054 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:41.827642 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:41.828906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1379a78f-c294-4051-b307-ae87b1ec9b80 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1744 microversion: 2.20 time: 0.155463 Sep 09 04:41:41.829543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 179/367] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:41 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:42.006801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:42.007469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:42.014630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:42.015148 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:42.015582 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:42.016283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:42.016916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:42.017161 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:42.146015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:42.154113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cd24af7c-04c7-4ee4-b927-ebad611b07f4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1709 microversion: 2.1 time: 0.151239 Sep 09 04:41:42.154672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 189/368] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:42 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:42.676285 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-44e8dfe5-d2aa-462a-8746-dbeb53d0e58c req-cb99aca8-3f61-4687-bc23-8bef77d67d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e", "name": "network-vif-plugged", "status": "completed", "tag": "4024da04-efc2-4a91-b9ed-e97cc0ac1f78"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:42.687496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-44e8dfe5-d2aa-462a-8746-dbeb53d0e58c req-cb99aca8-3f61-4687-bc23-8bef77d67d90 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:42.688121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-44e8dfe5-d2aa-462a-8746-dbeb53d0e58c req-cb99aca8-3f61-4687-bc23-8bef77d67d90 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:42.688395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-44e8dfe5-d2aa-462a-8746-dbeb53d0e58c req-cb99aca8-3f61-4687-bc23-8bef77d67d90 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:42.699945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-44e8dfe5-d2aa-462a-8746-dbeb53d0e58c req-cb99aca8-3f61-4687-bc23-8bef77d67d90 service nova] Creating event network-vif-plugged:4024da04-efc2-4a91-b9ed-e97cc0ac1f78 for instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e on hv-cinder-85600 Sep 09 04:41:42.704662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-44e8dfe5-d2aa-462a-8746-dbeb53d0e58c req-cb99aca8-3f61-4687-bc23-8bef77d67d90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032658 Sep 09 04:41:42.705398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 180/369] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:42.855886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:42.856494 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:42.862510 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:42.863093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:42.863528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:42.864780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:42.865298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:42.865919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:42.999572 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:43.007756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:43.009752 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:43.011251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e720de99-332c-4453-a4ab-ac12f27c7a4f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.160220 Sep 09 04:41:43.011983 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 190/370] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:42 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:43.178204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:43.178893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:43.185390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:43.185883 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:43.186537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:43.187262 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:43.187866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:43.188451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:43.341338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:43.355336 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-37283e40-7069-40a6-a1ec-5036aae6312e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1713 microversion: 2.1 time: 0.181180 Sep 09 04:41:43.356688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 181/371] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:41:43 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1713 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:41:44.037762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:44.038360 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:44.046101 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:44.046592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:44.047059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:44.047952 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:44.048580 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:44.049190 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:44.069042 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:44.186373 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:44.196473 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:44.198234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:44.199664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-dd1c17d1-edcf-4c00-adab-39490c11504f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.165783 Sep 09 04:41:44.200381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 191/372] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:44 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:45.227759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:45.228373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:45.235730 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:45.236221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:45.236659 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:45.237363 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:45.237818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:45.238243 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:45.392572 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:45.401287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:45.402838 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:45.406372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7002d026-7ab2-425b-be31-5407ae583c36 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.182538 Sep 09 04:41:45.407080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 182/373] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:45 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:41:46.434880 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:46.435637 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:46.442124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:46.442905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:46.443849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:46.444770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:46.446017 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:46.446655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:46.585996 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:46.596586 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:46.598022 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:46.600474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-63ac85ec-e505-4ca7-b79d-bc5ec418abb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.169378 Sep 09 04:41:46.601674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 192/374] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:46 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:47.627997 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:47.628561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:47.635640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:47.636122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:47.636692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:47.637391 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:47.637864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:47.638284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:47.776282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:47.784431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:47.785914 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:47.787122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-43a47bb4-5632-46ad-bb16-b7494753f3d7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.163192 Sep 09 04:41:47.787678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 183/375] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:47 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:48.814610 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:48.815429 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:48.822198 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:48.822862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:48.823478 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:48.824165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:48.824774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:48.825196 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:48.971297 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:48.980374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:48.981956 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:48.983273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2cf80397-51c1-45b6-bba4-edd88b85f3e6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.173200 Sep 09 04:41:48.990968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 193/376] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:48 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:50.009003 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:50.011493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:50.018086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:50.018794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:50.019268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:50.019978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:50.020437 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:50.020865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:50.171122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:50.180961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:50.182418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:50.183628 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-aad5240d-d469-4b91-a691-c075dc8e6d86 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.179121 Sep 09 04:41:50.184184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 184/377] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:50 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:51.210518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:51.211083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:51.219205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:51.219867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:51.220314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:51.221105 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:51.221689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:51.222115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:51.384124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:51.395567 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:51.397024 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:51.398231 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-87e15780-386f-41a4-bdbe-0db26492f1d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.192306 Sep 09 04:41:51.399181 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 194/378] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:51 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:52.425785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:52.426385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:52.432812 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:52.433288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:52.433719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:52.434398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:52.434843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:52.435301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:52.567296 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:52.576931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:52.579726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:52.580912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2c527463-244e-40f9-91a6-050519741fef tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.158969 Sep 09 04:41:52.581476 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 185/379] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:52 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:53.606710 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:53.607342 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:53.613693 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:53.614167 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:53.614604 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:53.615318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:53.615769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:53.616192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:53.743700 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:53.751671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:53.753127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:53.754283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b24ebdce-df2a-4822-a277-09a75929c2a3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.151371 Sep 09 04:41:53.754843 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 195/380] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:53 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:54.778795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:54.779454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:54.785834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:54.786380 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:54.786820 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:54.787545 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:54.787991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:54.788414 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:54.921784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:54.930617 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:54.932194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:54.933358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-122f96a2-fb68-40d8-b8ea-92b483d58289 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1739 microversion: 2.20 time: 0.158557 Sep 09 04:41:54.933922 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 186/381] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:54 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:55.240024 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:55.240573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:55.247587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:55.248065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:55.248495 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:55.249188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:55.249636 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:55.250058 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:55.273828 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f6e72bb1-2090-48ae-97af-fb91c99f6d52 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/ips" status: 200 len: 150 microversion: 2.1 time: 0.037584 Sep 09 04:41:55.274489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 196/382] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:41:55 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:55.959635 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:55.960252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:55.966658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:55.967174 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:55.967901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:55.968595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:55.969145 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:55.969459 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:56.104144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:56.112286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:56.113750 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:56.114907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fda19b26-101a-4686-b1dc-6745ba491b47 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1721 microversion: 2.20 time: 0.159152 Sep 09 04:41:56.115487 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 187/383] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:55 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:56.653221 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebafd939-adb2-4261-b497-6bbac22a3cd4"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:56.655676 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:56.657978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=42 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:41:56.663343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:56.663825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:56.664261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:56.664949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:56.665400 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:56.665852 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:57.140685 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:57.141290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:57.147600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:57.148081 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:57.148517 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:57.149206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:57.149658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:57.150083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:57.285759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:57.294192 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:57.295666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:57.296843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-baf538e0-1022-4ff2-94a8-b4afc7e469b0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1721 microversion: 2.20 time: 0.160072 Sep 09 04:41:57.297390 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 188/384] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:57 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:41:58.002840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-99e0f323-2d08-4732-8c40-908f6495e52c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.354050 Sep 09 04:41:58.004491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 197/385] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:41:56 2022] POST /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments => generated 194 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:41:58.322672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:58.323308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:58.329613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:58.330096 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:58.330529 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:58.331245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:58.331821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:58.332281 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:58.461125 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:58.469128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:58.470627 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:58.471759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a568abd1-cb2d-4932-8fc9-26e8ba2bee3b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1724 microversion: 2.20 time: 0.153540 Sep 09 04:41:58.472321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 189/386] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:58 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:41:58.497775 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71a551a3-7836-4bc8-b177-40855a6fd9d6"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:58.500301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:58.507182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:58.507746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:58.508091 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:58.509394 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:58.509879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:58.510268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:58.837005 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-be24ea5b-4a89-4b41-beca-89252a0e1d49 req-a8bc0967-2747-4f24-8855-98d5f9138bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e", "name": "network-vif-unplugged", "status": "completed", "tag": "4024da04-efc2-4a91-b9ed-e97cc0ac1f78"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:58.839055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e4b9e8d3-dc73-4dd4-986c-67c8eaef510b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346745 Sep 09 04:41:58.845174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 198/387] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Sep 9 04:41:58 2022] POST /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:41:58.853301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-be24ea5b-4a89-4b41-beca-89252a0e1d49 req-a8bc0967-2747-4f24-8855-98d5f9138bca service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:58.853766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-be24ea5b-4a89-4b41-beca-89252a0e1d49 req-a8bc0967-2747-4f24-8855-98d5f9138bca service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:58.854297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-be24ea5b-4a89-4b41-beca-89252a0e1d49 req-a8bc0967-2747-4f24-8855-98d5f9138bca service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:58.867760 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.compute.server_external_events [req-be24ea5b-4a89-4b41-beca-89252a0e1d49 req-a8bc0967-2747-4f24-8855-98d5f9138bca service nova] Unable to find a host for instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e. Dropping event network-vif-unplugged {{(pid=127437) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 04:41:58.869297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-be24ea5b-4a89-4b41-beca-89252a0e1d49 req-a8bc0967-2747-4f24-8855-98d5f9138bca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036204 Sep 09 04:41:58.870193 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 190/388] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 04:41:58.970816 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:41:58.971443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:58.978346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:58.978850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:58.979298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:58.979997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:58.980450 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:58.980876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:59.023836 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127436) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 04:41:59.093300 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9f765446-6c98-4079-9d75-d07a8ed1424a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/action" status: 202 len: 0 microversion: 2.20 time: 0.126386 Sep 09 04:41:59.094115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 199/389] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 04:41:58 2022] POST /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:41:59.103864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:41:59.104653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:41:59.112106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:59.112804 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:59.113473 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:59.114487 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:41:59.115183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:41:59.115841 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:41:59.248629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:59.257689 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:59.259427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:41:59.260950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6c4906f5-20bc-4921-afaa-f74938a8be4d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1750 microversion: 2.20 time: 0.162680 Sep 09 04:41:59.261664 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 191/390] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:41:59 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:00.287722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:00.288326 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:00.294734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:00.295254 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:00.295688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:00.296467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:00.296818 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:00.297243 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:00.428793 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:00.438076 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:00.439555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:00.440975 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-11dc95fe-49a1-4fbf-a1ef-f71190169a74 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1752 microversion: 2.20 time: 0.157708 Sep 09 04:42:00.441537 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 200/391] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:00 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:01.466761 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:01.467429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:01.469897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=44 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:01.475179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:01.475666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:01.476114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:01.476992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:01.477439 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:01.478040 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:01.618666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:01.628790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:01.630663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:01.632233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5aad20d4-cc96-4ad3-a954-80d5dfe02303 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1752 microversion: 2.20 time: 0.169337 Sep 09 04:42:01.633024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 192/392] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:01 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:02.665725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:02.667183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:02.673634 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:02.674118 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:02.674554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:02.675540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:02.675998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:02.676424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:02.804189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:02.812777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:02.814225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:02.815679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-27bc18a1-d3f9-452a-94a8-ad69b4b2c399 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1752 microversion: 2.20 time: 0.154018 Sep 09 04:42:02.816235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 201/393] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:02 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:03.844209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:03.844819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:03.851268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:03.851753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:03.852192 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:03.852881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:03.853941 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:03.854395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:03.979056 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:03.987495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:03.988947 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:03.990106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-09ec560f-2a4a-457b-804d-fc844977e5ff tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1752 microversion: 2.20 time: 0.149826 Sep 09 04:42:03.990665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 193/394] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:03 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:05.015084 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:05.015699 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:05.022115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:05.022616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:05.023065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:05.023757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:05.024209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:05.024660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:05.150727 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:05.159344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:05.160804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:05.161960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4b54dfd4-d892-4c15-beb0-69b4e9cad1d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1752 microversion: 2.20 time: 0.150784 Sep 09 04:42:05.162534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 202/395] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:05 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:42:05.576006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fbe428d5-a95a-4dc0-b4fc-53673391899a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: .version_select at 0x7f43fad97ee0>, body: {"keypair": {"name": "tempest-keypair-1705989547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHUb1DVvS8uKPB8S1qQl68WpOxfWxhTSfhlmDJwtFMu5zK7fxxgSFpBIDRxwdBKe9SUJ4OtZbDOFhzfRi3HRgzXko92MlY1khOlKNObf2Dzq8mwjE8WBoSQoPhk+ytuiQ=="}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:05.595446 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-fbe428d5-a95a-4dc0-b4fc-53673391899a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:42:05.599447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-fbe428d5-a95a-4dc0-b4fc-53673391899a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:42:05.623779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fbe428d5-a95a-4dc0-b4fc-53673391899a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053236 Sep 09 04:42:05.624389 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 194/396] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:42:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:42:06.187997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:06.188614 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:06.195620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:06.196113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:06.196551 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:06.197791 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:06.198246 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:06.198672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:06.217277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:06.425065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:06.435540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:06.437060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:06.438225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b05bfe6a-7e6e-4d80-9aa5-f9f1f3ea8052 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.254089 Sep 09 04:42:06.438776 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 203/397] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:06 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:07.384272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1302532654", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0"}], "security_groups": [{"name": "tempest-securitygroup--530360227"}], "key_name": "tempest-keypair-1705989547", "user_data": "}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:07.463786 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:07.464396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:07.470900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:07.471434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:07.471894 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:07.472620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:07.473074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:07.473499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:07.544334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] validate_networks() for [('38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:42:07.788350 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:07.798296 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:07.799876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:07.801119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-93b38ac9-a36b-4e59-8d1b-e4838f90360d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.341186 Sep 09 04:42:07.801685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 204/398] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:07 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:42:08.105417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:42:08.106505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:42:08.107008 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:42:08.107844 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:42:08.108263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:42:08.117138 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:08.117613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:08.118042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:08.119403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:08.119852 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:08.120274 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:08.136365 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:42:08.140233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:42:08.151745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:42:08.154022 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:42:08.202896 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f66986f9-abf0-4fb0-b6d5-e8f39d7dc81a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.822960 Sep 09 04:42:08.210155 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 195/399] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:42:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:42:08.217307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0aec7f76-6a7e-4eb1-a0a5-286bcbf3a5d4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:08.218122 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0aec7f76-6a7e-4eb1-a0a5-286bcbf3a5d4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:08.275655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0aec7f76-6a7e-4eb1-a0a5-286bcbf3a5d4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:08.282728 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0aec7f76-6a7e-4eb1-a0a5-286bcbf3a5d4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1242 microversion: 2.1 time: 0.070878 Sep 09 04:42:08.283664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 205/400] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:08 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:08.830974 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:08.832799 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:08.842708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:08.843553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:08.844193 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:08.845540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:08.846258 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:08.847148 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:08.992523 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:08.996219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:09.005312 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:09.007672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:09.009438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6da8a305-64de-4a69-9289-2b0e912bdcf6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.184327 Sep 09 04:42:09.023905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 196/401] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:08 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:09.305686 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:09.307022 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:09.314004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:09.315163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:09.315805 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:09.316708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:09.317347 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:09.317971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:09.380742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:09.388783 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-23d045f2-3468-4e83-8434-cbb5ce470317 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.086938 Sep 09 04:42:09.389341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 206/402] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:09 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:10.036779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:10.037999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:10.047124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:10.048824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:10.049499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:10.050472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:10.051205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:10.051892 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:10.202626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:10.211920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:10.213509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:10.214748 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-938253ef-10ec-489c-9d0f-21faa75bfb1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.181827 Sep 09 04:42:10.215422 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 197/403] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:10 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:10.413294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:10.413909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:10.420997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:10.422067 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:10.422516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:10.423251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:10.423708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:10.424134 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:10.496463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:10.504244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-daaad554-9dab-47d6-9a01-6ef3abe7a754 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.094830 Sep 09 04:42:10.504803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 207/404] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:10 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:11.241078 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:11.241784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:11.248759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:11.249242 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:11.249677 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:11.250377 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:11.250827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:11.251277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:11.404667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:11.415985 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:11.417697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:11.419211 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1a5f9080-282e-41b0-95d8-acf4377f7325 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.182085 Sep 09 04:42:11.420567 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 198/405] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:11 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:11.528989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:11.530751 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:11.538629 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:11.539424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:11.540014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:11.541317 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:11.542107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:11.542676 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:11.604969 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:11.613905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d1274f10-142a-4301-895e-45d1e6427b3c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.090273 Sep 09 04:42:11.614980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 208/406] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:11 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:12.448988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:12.449591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:12.456201 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:12.457099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:12.457755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:12.458697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:12.459394 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:12.460062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:12.624615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:12.639924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:12.641727 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:12.646783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:12.648489 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:12.649729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6545cc9e-4e92-4d1c-84b2-aa328e144e18 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.205092 Sep 09 04:42:12.650294 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 199/407] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:12 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:12.650658 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:12.651643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:12.652260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:12.653126 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:12.653735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:12.654332 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:12.731322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:12.740018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-57ebb88a-bef9-4e8e-9226-7bce09c1305c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.105566 Sep 09 04:42:12.740596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 209/408] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:12 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:13.674738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:13.675479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:13.682199 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:13.682684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:13.683162 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:13.683857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:13.684306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:13.684727 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:13.769059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:13.771146 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:13.781364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:13.782180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:13.782844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:13.783884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:13.784689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:13.785341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:13.840109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:13.856204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:13.857678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:13.858244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:13.859095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3b453c53-27ef-4913-82a3-846c313f6b13 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.188184 Sep 09 04:42:13.867227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 200/409] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:13 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:13.873028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e42417db-f926-4d01-b579-90b431ee4b51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.107674 Sep 09 04:42:13.875059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 210/410] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:13 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:14.892303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:14.893282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:14.897537 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:14.898292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:14.899931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:14.900418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:14.900855 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:14.901554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:14.902004 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:14.902427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:14.904729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:14.905209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:14.905647 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:14.906337 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:14.906789 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:14.907242 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:15.010571 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:15.023513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e8712f75-fecb-451f-a5f2-21c8248039d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.129271 Sep 09 04:42:15.035568 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 211/411] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:14 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:15.078547 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:15.087143 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:15.088592 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:15.089747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-689d238a-aed9-499b-a671-d3f2d52c958e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.201379 Sep 09 04:42:15.090307 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 201/412] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:14 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:15.673453 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b050a325-e1aa-48eb-8256-4b37e1a8d00c"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:15.678498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:15.688340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:15.688828 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:15.689260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:15.690255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:15.690703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:15.691153 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:16.047629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:16.048286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:16.054697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:16.055207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:16.055642 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:16.056332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:16.056783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:16.057205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:16.122506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:16.130439 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3ec5b1d9-4f8e-4485-a810-fbd28e5c468a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.086834 Sep 09 04:42:16.131017 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 202/413] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:16 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:16.144712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:16.145402 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:16.152053 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:16.152535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:16.152970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:16.153673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:16.154124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:16.154550 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:16.294034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:16.304707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:16.306284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:16.307738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2df57d8b-2585-459d-9942-a5ea8615616b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.169481 Sep 09 04:42:16.316252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 203/414] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:16 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:17.154205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:17.155038 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:17.161224 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:17.161679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:17.162109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:17.162786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:17.163276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:17.163691 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:17.232243 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:17.239874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a6c595af-6697-4ec6-a451-6a4cbc133f84 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1246 microversion: 2.1 time: 0.090046 Sep 09 04:42:17.240435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 204/415] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:17 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:17.336966 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:17.337577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:17.344104 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:17.344634 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:17.345077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:17.345783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:17.346238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:17.346668 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:17.479253 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:17.487836 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:17.489228 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:17.490411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-38b850be-e1d0-4e31-9709-3805d2b88ae9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.157433 Sep 09 04:42:17.491023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 205/416] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:17 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:42:18.262565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:18.263235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:18.265063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:18.265771 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=10 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:18.272095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:18.272575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:18.273003 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:18.273719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:18.274546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:18.274546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:18.280371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:18.344255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:18.351885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a16bc4d5-62af-42a4-ad7b-0d2468621c73 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1238 microversion: 2.1 time: 0.093238 Sep 09 04:42:18.352453 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 206/417] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:18 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:18.515591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:18.516209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:18.522070 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:18.522585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:18.523061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:18.523785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:18.524245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:18.524674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:18.666738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:18.676509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:18.678114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:18.684515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-aea72159-90ff-4295-8ce7-2b7d4cc7d00f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.172763 Sep 09 04:42:18.690972 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 207/418] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:18 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:42:18.708712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-bf071b9e-add7-4b73-a34c-7f43d24f7b9a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.051204 Sep 09 04:42:18.709326 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 212/419] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:42:15 2022] POST /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments => generated 194 bytes in 3053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:42:19.376560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:19.377205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:19.383847 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:19.384362 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:19.384806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:19.386401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:19.386855 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:19.387313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:19.450347 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:19.457925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ae35c583-c4df-46dd-9ea9-1f66e4764af0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1294 microversion: 2.1 time: 0.085307 Sep 09 04:42:19.458639 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 208/420] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:19 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:19.713075 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:19.714076 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:19.721100 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:19.721846 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:19.722392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:19.723264 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:19.723868 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:19.724516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:19.867395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:19.877113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:19.878613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:19.879824 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2a522764-bbff-4885-8679-41dd564c4133 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.171610 Sep 09 04:42:19.880395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 213/421] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:19 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:20.480647 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:20.481408 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:20.488424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:20.489058 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:20.489502 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:20.490196 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:20.491182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:20.491296 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:20.738251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:20.746159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-eb856e98-d881-45ab-8e59-34326669f163 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.269321 Sep 09 04:42:20.747078 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 209/422] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:20 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:20.907426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:20.908639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:20.929001 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:20.929708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:20.930320 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:20.931356 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:20.932527 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:20.933165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:21.159494 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:21.168104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:21.169602 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:21.170815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-200ec352-1eac-448a-ba58-543ab26f5a73 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.267261 Sep 09 04:42:21.187142 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 214/423] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:20 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:21.257746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-24bdc12b-2f34-4c90-8ad3-b88a5eafc935 req-ae93c412-c1e9-4602-bdf9-6a15377c5405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4491bf38-2476-4d98-81a8-4d82393cc599", "tag": "b3446042-9774-408b-aa51-4ba658c97b30"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:21.270358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-24bdc12b-2f34-4c90-8ad3-b88a5eafc935 req-ae93c412-c1e9-4602-bdf9-6a15377c5405 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:21.270958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-24bdc12b-2f34-4c90-8ad3-b88a5eafc935 req-ae93c412-c1e9-4602-bdf9-6a15377c5405 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:21.271473 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-24bdc12b-2f34-4c90-8ad3-b88a5eafc935 req-ae93c412-c1e9-4602-bdf9-6a15377c5405 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:21.282200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-24bdc12b-2f34-4c90-8ad3-b88a5eafc935 req-ae93c412-c1e9-4602-bdf9-6a15377c5405 service nova] Creating event network-changed:b3446042-9774-408b-aa51-4ba658c97b30 for instance 4491bf38-2476-4d98-81a8-4d82393cc599 on hv-cinder-85600 Sep 09 04:42:21.287144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-24bdc12b-2f34-4c90-8ad3-b88a5eafc935 req-ae93c412-c1e9-4602-bdf9-6a15377c5405 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033623 Sep 09 04:42:21.287851 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 210/424] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:42:21.769812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:21.770418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:21.777369 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:21.777852 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:21.778288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:21.779004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:21.779463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:21.779893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:21.907445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:21.915263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-83366905-c9a9-4f26-ad3b-36adc8425334 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.149321 Sep 09 04:42:21.915866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 215/425] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:21 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:22.198752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:22.199477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:22.205590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:22.206077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:22.206512 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:22.207250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:22.207700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:22.208126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:22.362734 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:22.372253 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:22.373631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:22.374791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-75eb7887-d64a-4f67-a26d-7945b2ca8186 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.181263 Sep 09 04:42:22.375386 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 211/426] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:22 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:22.938230 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:22.938842 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:22.945857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:22.946335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:22.946768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:22.947540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:22.947994 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:22.948415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:23.147098 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:23.155376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4a053be4-14bc-420a-9203-c3bf8c379c6a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.221043 Sep 09 04:42:23.155959 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 216/427] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:22 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:23.400963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:23.401578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:23.408050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:23.408534 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:23.408971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:23.409662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:23.410115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:23.410536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:23.785534 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:23.794052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:23.795537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:23.796693 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9fd8faac-cc15-42b4-b42c-4452cd2167e7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.400104 Sep 09 04:42:23.797249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 212/428] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:23 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:24.178565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:24.179191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:24.186119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:24.186592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:24.187048 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:24.187731 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:24.188174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:24.188593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:24.313531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:24.321294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-bfd91b89-c665-4b35-84e0-2be736413983 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.146567 Sep 09 04:42:24.321861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 217/429] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:24 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:24.821907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:24.822553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:24.828920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:24.829403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:24.829840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:24.830531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:24.831002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:24.831431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:24.967686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:24.976429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:24.977889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:24.979163 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bc9a99fe-16a4-479a-8f52-86874deaf6f9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.161162 Sep 09 04:42:24.979913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 213/430] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:24 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:25.034406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:25.035081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:25.041010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:25.041490 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:25.041918 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:25.042605 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:25.043087 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:25.043509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:25.183933 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lazy-loading 'services' on Instance uuid 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:42:25.305383 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-289d7fc1-7d10-455b-a673-ce04223e4251 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-volume_attachments/c0da1d0b-6850-4986-b2bc-0877968a563a" status: 202 len: 0 microversion: 2.1 time: 0.274808 Sep 09 04:42:25.306512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 218/431] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:42:25 2022] DELETE /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-volume_attachments/c0da1d0b-6850-4986-b2bc-0877968a563a => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:42:25.344007 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:25.344719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:25.350758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:25.351306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:25.351748 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:25.352460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:25.353081 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:25.353715 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:25.358007 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:25.485204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:25.493632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-444a92eb-1413-4771-b0e9-f7f5e1de8c1f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.153592 Sep 09 04:42:25.494779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 214/432] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:25 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:26.004814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:26.005546 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:26.011679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.012169 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.012607 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.013307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.013762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.014194 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.018185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:26.154763 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:26.164718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:26.167314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:26.168766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-85eddda5-6456-4853-a0e3-c1647b9857aa tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.168249 Sep 09 04:42:26.169530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 219/433] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:25 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:26.282549 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:26.285515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:26.292834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.293671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.294708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.295661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.296464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.297126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.322129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lazy-loading 'flavor' on Instance uuid 81b697ec-4fe5-4eb3-95c9-6890c141915b {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:42:26.442491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8f148fc7-bb64-4e56-8134-516e364d9c27 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/action" status: 200 len: 32 microversion: 2.1 time: 0.163852 Sep 09 04:42:26.443157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 215/434] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:42:26 2022] POST /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 04:42:26.453050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:26.453800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:26.460392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.460854 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.461353 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.462163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.462747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.463770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.518778 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:26.519586 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:26.526913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.527567 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.528190 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.529161 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:26.529677 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:26.530361 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:26.733470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:26.741754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a67a9be5-077a-4bea-81bf-7b4e2bb9f87f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.292635 Sep 09 04:42:26.742413 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 220/435] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:26 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:26.781885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:26.790029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-64d9aab5-1f08-4c42-8c1b-586731a89a1b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.276806 Sep 09 04:42:26.790605 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 216/436] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:26 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:27.193691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:27.194341 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:27.196144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:27.202252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.202724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.203180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.203874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.204325 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.204742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.335286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:27.344428 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:27.345872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:27.347051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0cea70f6-a77c-4bf7-8bca-72611c0ddddc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.157414 Sep 09 04:42:27.347606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 221/437] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:27 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:27.505436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-90167abb-b73c-4f4e-a08c-26e836c6bc1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:27.512252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90167abb-b73c-4f4e-a08c-26e836c6bc1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.512732 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90167abb-b73c-4f4e-a08c-26e836c6bc1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.513171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-90167abb-b73c-4f4e-a08c-26e836c6bc1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.535337 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-90167abb-b73c-4f4e-a08c-26e836c6bc1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Going to try to stop instance {{(pid=127437) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 04:42:27.575111 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-90167abb-b73c-4f4e-a08c-26e836c6bc1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action" status: 202 len: 0 microversion: 2.1 time: 0.073265 Sep 09 04:42:27.575886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 217/438] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:42:27 2022] POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:42:27.584124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:27.584652 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:27.591702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.592197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.592620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.593316 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.593770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.594191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.730924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:27.739157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9b5f1226-36d0-4215-8dbb-2789989a7242 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.158968 Sep 09 04:42:27.739745 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 222/439] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:27 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:27.765778 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:27.766501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:27.772882 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.773370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.773810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.774503 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.774981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.775410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.813634 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:27.814339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:27.820722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.821304 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.821811 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.823437 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.823981 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:27.824472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:27.966523 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:27.975127 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f61da635-384a-47ff-9f4e-66bc0687620f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.213510 Sep 09 04:42:27.976378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 218/440] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:27 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:27.981918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-f923acb4-a601-4e70-b5ef-b623d380956c req-57420be3-b1c9-4364-8524-a7de7e67900c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e", "name": "network-vif-plugged", "status": "completed", "tag": "4024da04-efc2-4a91-b9ed-e97cc0ac1f78"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:27.991607 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f923acb4-a601-4e70-b5ef-b623d380956c req-57420be3-b1c9-4364-8524-a7de7e67900c service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:27.995445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:28.000042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f923acb4-a601-4e70-b5ef-b623d380956c req-57420be3-b1c9-4364-8524-a7de7e67900c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:28.000501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f923acb4-a601-4e70-b5ef-b623d380956c req-57420be3-b1c9-4364-8524-a7de7e67900c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:28.009059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9ea1739a-d13d-4fbe-a1d7-3c0e0d29c601 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.199522 Sep 09 04:42:28.009690 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 223/441] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:27 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:28.017708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-f923acb4-a601-4e70-b5ef-b623d380956c req-57420be3-b1c9-4364-8524-a7de7e67900c service nova] Creating event network-vif-plugged:4024da04-efc2-4a91-b9ed-e97cc0ac1f78 for instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e on hv-cinder-85600 Sep 09 04:42:28.025884 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-f923acb4-a601-4e70-b5ef-b623d380956c req-57420be3-b1c9-4364-8524-a7de7e67900c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047650 Sep 09 04:42:28.026505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 219/442] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:42:28.372333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:28.372881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:28.378878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:28.379390 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:28.379825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:28.380511 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:28.380962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:28.381387 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:28.515963 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:28.524862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:28.526804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:28.528029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-de611682-2778-4f88-984c-ac2aca5349c0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.159696 Sep 09 04:42:28.528788 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 224/443] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:28 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:28.764521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:28.765213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:28.771334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:28.771810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:28.772248 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:28.772921 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:28.773366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:28.773784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:28.901236 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:28.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2edd9107-b8ea-4c45-b479-13afce12d722 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.150250 Sep 09 04:42:28.909969 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 220/444] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:28 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:29.001510 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:29.002155 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:29.008539 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.009024 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.009466 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:29.010657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.011148 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.011576 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:29.033418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:29.034021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:29.039758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.040233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.040666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:29.041350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.041799 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.042223 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:29.206741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:29.210674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:29.215217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8b6719a4-b2cf-4a8c-b65f-4bfb113a119c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.217288 Sep 09 04:42:29.215731 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 225/445] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:28 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:29.218251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-69f6f477-d46d-43c0-a9ce-1163668b0aa8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.188639 Sep 09 04:42:29.218806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 221/446] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:29 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:29.553880 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:29.554415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:29.561319 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.561815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.562252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:29.563011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.563469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.563897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:29.694446 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:29.703019 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:29.704467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:29.705630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-df8493ea-4c29-4273-ab3e-ecbd3b9215e0 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.155761 Sep 09 04:42:29.706194 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 226/447] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:29 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:29.932416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:29.933032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:29.939339 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.939813 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.940499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:29.941182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:29.941625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:29.942044 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.042580 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-408fb872-44e6-430c-9af0-dbc399da150b req-d4b36198-1ea8-4360-82b9-ddbd99fc33ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4491bf38-2476-4d98-81a8-4d82393cc599", "name": "network-vif-plugged", "status": "completed", "tag": "b3446042-9774-408b-aa51-4ba658c97b30"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:30.052327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-408fb872-44e6-430c-9af0-dbc399da150b req-d4b36198-1ea8-4360-82b9-ddbd99fc33ed service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:30.052802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-408fb872-44e6-430c-9af0-dbc399da150b req-d4b36198-1ea8-4360-82b9-ddbd99fc33ed service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:30.053225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-408fb872-44e6-430c-9af0-dbc399da150b req-d4b36198-1ea8-4360-82b9-ddbd99fc33ed service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.063885 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-408fb872-44e6-430c-9af0-dbc399da150b req-d4b36198-1ea8-4360-82b9-ddbd99fc33ed service nova] Creating event network-vif-plugged:b3446042-9774-408b-aa51-4ba658c97b30 for instance 4491bf38-2476-4d98-81a8-4d82393cc599 on hv-cinder-85600 Sep 09 04:42:30.066963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:30.068891 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-408fb872-44e6-430c-9af0-dbc399da150b req-d4b36198-1ea8-4360-82b9-ddbd99fc33ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 Sep 09 04:42:30.069550 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 227/448] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:42:30.075490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-cf04e5ce-fde8-4b1b-a2aa-1e39fded1b83 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.146872 Sep 09 04:42:30.076054 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 222/449] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:29 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:30.239174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:30.239823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:30.240279 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:30.240896 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:30.245934 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:30.246418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:30.246687 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:30.246850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.247216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:30.247562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:30.247666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.248010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:30.248345 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:30.248447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.248806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:30.249235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.441807 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:30.444898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:30.450667 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4a682e38-5f5c-4448-83d4-7f93d4f9a44e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.215779 Sep 09 04:42:30.451281 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 228/450] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:30 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:30.452905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f1d67643-782c-4c09-9436-c0f06902a2ad tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.216417 Sep 09 04:42:30.453461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 223/451] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:30 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:30.729972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:30.730646 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:30.737107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:30.737638 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:30.738115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.739332 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:30.739415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:30.739799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:30.929127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:30.938665 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:30.940384 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:30.941679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e85d87b3-8bc2-486c-9af9-5f7c2c4bae1c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1808 microversion: 2.20 time: 0.215828 Sep 09 04:42:30.942267 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 229/452] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:30 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:42:31.099131 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:31.099845 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:31.106181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.106665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.107137 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:31.107867 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.108389 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.108819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:31.239908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:31.247949 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-80e41839-69fa-48f9-a026-854fda6a4d14 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.152780 Sep 09 04:42:31.248503 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 224/453] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:31 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:31.475416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:31.476015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:31.476272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:31.476891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:31.482620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.482771 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.483144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.483269 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.483585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:31.483700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:31.484276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.484388 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.484730 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.484864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.485153 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:31.485272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:31.677738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:31.681184 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:31.686076 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-997d7171-3c1b-4d64-a85c-a3b07c185dcd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1367 microversion: 2.1 time: 0.213645 Sep 09 04:42:31.686643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 225/454] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:31 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:31.691139 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2ef8af23-d024-4ea3-aeab-cbec2b048c38 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.219830 Sep 09 04:42:31.691715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 230/455] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:31 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:31.967642 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:31.968247 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:31.970149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:31.976050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.976528 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.976959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:31.977641 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:31.978085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:31.978505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.109583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:32.118223 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:32.119713 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:32.120885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-04df245a-21d7-4f4b-b26c-d20fa27ce35b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1795 microversion: 2.20 time: 0.157130 Sep 09 04:42:32.121446 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 226/456] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:42:31 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:42:32.272889 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:32.273499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:32.279872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.280350 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.280780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.281468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.281916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.282338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.410655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:32.419034 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-81f252a8-8917-46f6-bbaf-54f832248e55 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.150167 Sep 09 04:42:32.419613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 231/457] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:32 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:32.709498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:32.710107 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:32.714913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:32.715550 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:32.717451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.717927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.718365 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.719083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.719876 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.720306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.721978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.722466 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.722908 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.723638 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.724097 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.724530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.917395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:32.921176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:32.925490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1ef25380-cde3-4a5c-a168-61164c8be765 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1558 microversion: 2.1 time: 0.219992 Sep 09 04:42:32.926068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 227/458] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:32 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:32.929588 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-64e8a278-57c2-4ce7-adf9-c0f1d9c0da32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.219014 Sep 09 04:42:32.930152 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 232/459] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:32 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:32.948626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:32.949204 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:32.955312 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.955817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.956254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.956943 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:32.957393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:32.957818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:32.974107 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:33.038351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8bacf045-68e9-48c3-8b30-c6df5483d74c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094124 Sep 09 04:42:33.038973 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 228/460] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:42:32 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:42:33.442138 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:33.442780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:33.448789 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:33.449278 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:33.449741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:33.450444 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:33.450895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:33.451344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:33.673390 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:33.681113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5000790f-4310-4eb9-975e-7caf380e9ddc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.243121 Sep 09 04:42:33.681698 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 233/461] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:33 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:33.954430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:33.955053 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:33.960882 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:33.961365 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:33.961801 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:33.962495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:33.962958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:33.963388 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:34.050483 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-2dfd4920-00d2-4fe6-ba7c-d0443ba41dc3 req-27603322-8013-49d5-a3ad-30d7dee35369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4491bf38-2476-4d98-81a8-4d82393cc599", "tag": "b3446042-9774-408b-aa51-4ba658c97b30"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:34.060401 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2dfd4920-00d2-4fe6-ba7c-d0443ba41dc3 req-27603322-8013-49d5-a3ad-30d7dee35369 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:34.060888 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2dfd4920-00d2-4fe6-ba7c-d0443ba41dc3 req-27603322-8013-49d5-a3ad-30d7dee35369 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:34.061327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2dfd4920-00d2-4fe6-ba7c-d0443ba41dc3 req-27603322-8013-49d5-a3ad-30d7dee35369 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:34.073866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-2dfd4920-00d2-4fe6-ba7c-d0443ba41dc3 req-27603322-8013-49d5-a3ad-30d7dee35369 service nova] Creating event network-changed:b3446042-9774-408b-aa51-4ba658c97b30 for instance 4491bf38-2476-4d98-81a8-4d82393cc599 on hv-cinder-85600 Sep 09 04:42:34.078838 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-2dfd4920-00d2-4fe6-ba7c-d0443ba41dc3 req-27603322-8013-49d5-a3ad-30d7dee35369 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032003 Sep 09 04:42:34.079661 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 234/462] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:42:34.113810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:34.122238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-860bddd8-64d4-40c1-8d46-b1f38cf74d2a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.172159 Sep 09 04:42:34.122827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 229/463] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:33 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:34.706050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:34.706658 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:34.714104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:34.714600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:34.715064 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:34.715830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:34.716235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:34.716660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:34.924739 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:34.933696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-41a10677-6872-4716-bb4f-5662cead7d05 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.232038 Sep 09 04:42:34.947171 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 235/464] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:34 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:35.145634 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:35.146254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:35.153796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:35.154278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:35.154720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:35.155473 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:35.155931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:35.156359 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:35.286692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:35.295448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4e88aeb0-8a0f-49bb-9316-8e870377e8a0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.153594 Sep 09 04:42:35.296010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 230/465] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:35 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:35.957579 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:35.958207 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:35.964711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:35.965187 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:35.965687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:35.966366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:35.966812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:35.967260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:36.094015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:36.101625 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4990e8e2-1578-46eb-a2bb-c75a8136fd30 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.147895 Sep 09 04:42:36.102186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 236/466] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:35 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:36.318686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:36.319321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:36.325771 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:36.326250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:36.326693 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:36.327425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:36.327879 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:36.328305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:36.456264 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:36.464382 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f3872b30-5df5-405a-8391-a9eadfd5e590 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.149883 Sep 09 04:42:36.464945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 231/467] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:36 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:37.124536 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:37.125170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:37.131519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:37.132031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:37.132462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:37.133258 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:37.133723 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:37.134131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:37.138559 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:37.261933 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:37.269745 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d63b45cb-bb95-447d-960b-1498bb21c6ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1677 microversion: 2.1 time: 0.149037 Sep 09 04:42:37.270299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 237/468] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:37 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:37.487741 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:37.488459 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:37.495321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:37.495806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:37.496246 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:37.496940 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:37.497398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:37.497843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:37.628440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:37.637287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7ece2aed-8cac-4dfc-9291-3527441ff50a tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.153413 Sep 09 04:42:37.637859 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 232/469] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:37 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:38.294092 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:38.294712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:38.301176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:38.301660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:38.302097 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:38.302792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:38.303274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:38.303699 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:38.432241 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:38.439987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b6fb32af-9b72-45d9-aba8-ff352aa1620c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1654 microversion: 2.1 time: 0.150443 Sep 09 04:42:38.440814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 238/470] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:38 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:38.462773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-37c81666-c3ab-469f-bd9b-aa2a337fa1d6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:38.469400 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37c81666-c3ab-469f-bd9b-aa2a337fa1d6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:38.469879 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37c81666-c3ab-469f-bd9b-aa2a337fa1d6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:38.470338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-37c81666-c3ab-469f-bd9b-aa2a337fa1d6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:38.491436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-37c81666-c3ab-469f-bd9b-aa2a337fa1d6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Going to try to start instance {{(pid=127437) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 04:42:38.532787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-37c81666-c3ab-469f-bd9b-aa2a337fa1d6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action" status: 202 len: 0 microversion: 2.1 time: 0.073598 Sep 09 04:42:38.533371 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 233/471] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:42:38 2022] POST /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:42:38.541485 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:38.542130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:38.548093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:38.548711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:38.549263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:38.550053 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:38.550560 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:38.551263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:38.665916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:38.667191 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:38.674248 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:38.674745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:38.675212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:38.675915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:38.676364 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:38.676836 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:38.694217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:38.702386 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cce693b5-c114-48b4-b4f1-8e82aced4fe8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1663 microversion: 2.1 time: 0.164696 Sep 09 04:42:38.703278 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 239/472] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:38 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:38.868319 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:38.877037 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bb545a4b-4682-4364-9d6a-ed9699335642 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.215687 Sep 09 04:42:38.877596 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 234/473] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:38 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:42:39.726314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:39.726913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:39.734543 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:39.735059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:39.735517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:39.736205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:39.736651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:39.737071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:39.863555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:39.871296 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-943fa529-1319-41ac-a8d1-d02d0f6a3353 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1667 microversion: 2.1 time: 0.149223 Sep 09 04:42:39.871857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 240/474] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:39 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:39.901897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:39.902554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:39.910720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:39.911236 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:39.911678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:39.912374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:39.912862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:39.913286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:40.045186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:40.053459 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1094c24c-faaf-4845-a6b1-15ea7e7ce8c0 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.155891 Sep 09 04:42:40.054028 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 235/475] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:39 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:41.076684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:41.077295 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:41.083762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:41.084245 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:41.084678 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:41.085373 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:41.085824 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:41.086248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:41.214523 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:41.222717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f5594695-bb01-4240-af7f-dbb602dbcf40 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.149863 Sep 09 04:42:41.223260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 241/476] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:41 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:42.246638 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:42.247277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:42.253769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:42.254244 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:42.254679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:42.255392 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:42.255845 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:42.256274 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:42.381949 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:42.390610 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a05f4bd0-764c-4df1-926d-4616639aa291 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.147881 Sep 09 04:42:42.391225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 236/477] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:42 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:43.413626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:43.414251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:43.421408 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:43.421894 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:43.422328 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:43.423034 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:43.423486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:43.423907 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:43.553441 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:43.561584 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e63c4dcd-ea37-4e75-9bd5-37bac0c96d37 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.151842 Sep 09 04:42:43.562139 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 242/478] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:43 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:44.584681 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:44.585291 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:44.591809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:44.592283 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:44.592715 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:44.593401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:44.593849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:44.594267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:44.720233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:44.728437 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c414a22d-827b-48b2-9656-a81da917c144 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.147633 Sep 09 04:42:44.729505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 237/479] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:44 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:45.751848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:45.752456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:45.759033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:45.759520 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:45.759958 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:45.761215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:45.761672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:45.762102 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:45.890322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:45.899170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-75ce6863-8820-4bb9-87f4-180db5c047f5 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.151079 Sep 09 04:42:45.899747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 243/480] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:45 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:46.922338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:46.922968 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:46.929370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:46.929849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:46.930393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:46.931123 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:46.931572 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:46.932404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:47.062531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:47.071062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-dd845b70-52b6-45aa-a0cb-70ed55965513 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.152586 Sep 09 04:42:47.071623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 238/481] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:46 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:48.094562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:48.095268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:48.101703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:48.102189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:48.102632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:48.103354 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:48.104441 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:48.104878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:48.236455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:48.244747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8949d905-8d05-4179-84ff-94cab9b316d3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.154125 Sep 09 04:42:48.245321 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:48 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:49.268087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:49.268693 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:49.275264 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:49.275742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:49.276173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:49.276857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:49.277302 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:49.277721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:49.402576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:49.410624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4eadcc6f-b0f6-4b52-bbd4-36079facd000 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.146412 Sep 09 04:42:49.411215 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 239/483] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:49 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:50.435131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:50.435741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:50.442509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:50.443030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:50.443468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:50.444191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:50.444645 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:50.445072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:50.573946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:50.582119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-31c9d8ef-d77d-4ca5-a7f8-e620703d2586 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1733 microversion: 2.1 time: 0.151466 Sep 09 04:42:50.582686 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 245/484] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:50 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:51.604977 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:51.605548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:51.611849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:51.612332 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:51.612772 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:51.613461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:51.613915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:51.614454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:51.742404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:51.751167 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a20e78a5-9a2f-4f34-a94e-1d61fd1befe9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1713 microversion: 2.1 time: 0.150099 Sep 09 04:42:51.751966 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 240/485] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:51 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:51.859611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:51.860095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:51.866310 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:51.866785 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:51.867251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:51.867942 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:51.868392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:51.868811 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:51.947432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] HTTP exception thrown: Cannot 'detach_volume' instance 81b697ec-4fe5-4eb3-95c9-6890c141915b while it is in vm_state rescued Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Request method failure captured: Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: DELETE /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments/b050a325-e1aa-48eb-8256-4b37e1a8d00c HTTP/1.1 Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNm00-OuUMYpqLU-J1jDk2uHbHSIG7fwOGXAsJizzmC3IGtmdzcTkbUTGdBfwF-GNLFmqjzV-A2UZ7VM-Z2a63MqouKGWM-O5fUuh8a41_gduvl7Vjy57JW6yHtIoeX_3BtvBxjBtfT_Pjl5GxVSgPjQ2GfGF3bJAgmpGxvvWFkjHg Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:42:51.949077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}] Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: d3c29c23d7524adf9c5a3271224ac8d3 Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:42:51.950664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Cannot 'detach_volume' instance 81b697ec-4fe5-4eb3-95c9-6890c141915b while it is in vm_state rescued Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'server_id': '81b697ec-4fe5-4eb3-95c9-6890c141915b', 'id': 'b050a325-e1aa-48eb-8256-4b37e1a8d00c'} Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81b697ec-4fe5-4eb3-95c9-6890c141915b in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:42:51.951562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 81b697ec-4fe5-4eb3-95c9-6890c141915b while it is in vm_state rescued Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 81b697ec-4fe5-4eb3-95c9-6890c141915b while it is in vm_state rescued Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:42:51.953107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Returning 409 to user: Cannot 'detach_volume' instance 81b697ec-4fe5-4eb3-95c9-6890c141915b while it is in vm_state rescued {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:42:51.954531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-893d505b-4261-432e-8622-49f169106c06 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments/b050a325-e1aa-48eb-8256-4b37e1a8d00c" status: 409 len: 152 microversion: 2.1 time: 0.094942 Sep 09 04:42:51.954531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 246/486] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:42:51 2022] DELETE /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments/b050a325-e1aa-48eb-8256-4b37e1a8d00c => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 04:42:51.959613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:51.960147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:51.965950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:51.966438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:51.966876 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:51.967599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:51.968053 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:51.968480 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:52.036782 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-78f2bfc7-cb18-4051-bde8-6cafd3e6e816 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "POST /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/action" status: 202 len: 0 microversion: 2.1 time: 0.080817 Sep 09 04:42:52.037521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 241/487] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:42:51 2022] POST /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:42:52.046801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:52.047445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:52.053725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:52.054285 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:52.054792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:52.055680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:52.056165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:52.056627 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:52.264722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:52.273236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-274cf27f-224c-4494-8957-bdfd9053ed35 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1721 microversion: 2.1 time: 0.230889 Sep 09 04:42:52.273814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 247/488] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:52 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:53.297336 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:53.298163 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:53.304755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:53.305238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:53.305678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:53.306372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:53.306823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:53.307271 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:53.433664 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:53.442046 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bd8233e4-6501-4981-863b-70c43c2e06c6 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1721 microversion: 2.1 time: 0.149569 Sep 09 04:42:53.442599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 242/489] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:53 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:54.465633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:54.466239 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:54.472638 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:54.473117 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:54.473549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:54.474235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:54.474685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:54.475142 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:54.602421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:54.611151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-81eeb027-0eb1-4aa7-97e1-8ee2d86274dd tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1721 microversion: 2.1 time: 0.149422 Sep 09 04:42:54.611712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 248/490] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:54 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:55.633824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:55.634403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:55.642235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:55.642720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:55.643229 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:55.644021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:55.644562 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:55.645076 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:55.664122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:55.775404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:42:55.783468 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-97d2d468-9963-488b-a6d3-15be11e91eb1 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1727 microversion: 2.1 time: 0.153788 Sep 09 04:42:55.784181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 243/491] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:42:55 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:42:55.806358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:42:55.806859 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:42:55.813979 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:55.814467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:55.814907 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:55.815879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:55.816332 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:55.816761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:55.891112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d0efe2de-9be6-4538-9b00-079014228b59 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088543 Sep 09 04:42:55.891749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 249/492] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:42:55 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:42:56.762758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-d195e325-ed01-42cd-a685-cd3f05ffc3d4 req-8416c9df-7e47-4d1d-9f88-582869318bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b697ec-4fe5-4eb3-95c9-6890c141915b", "tag": "e2bb2333-df06-4b43-a41b-37e81ef693cb"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:56.773421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-d195e325-ed01-42cd-a685-cd3f05ffc3d4 req-8416c9df-7e47-4d1d-9f88-582869318bee service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:56.773898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-d195e325-ed01-42cd-a685-cd3f05ffc3d4 req-8416c9df-7e47-4d1d-9f88-582869318bee service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:56.774327 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-d195e325-ed01-42cd-a685-cd3f05ffc3d4 req-8416c9df-7e47-4d1d-9f88-582869318bee service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:56.785838 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-d195e325-ed01-42cd-a685-cd3f05ffc3d4 req-8416c9df-7e47-4d1d-9f88-582869318bee service nova] Creating event network-changed:e2bb2333-df06-4b43-a41b-37e81ef693cb for instance 81b697ec-4fe5-4eb3-95c9-6890c141915b on hv-cinder-85600 Sep 09 04:42:56.790843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-d195e325-ed01-42cd-a685-cd3f05ffc3d4 req-8416c9df-7e47-4d1d-9f88-582869318bee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032254 Sep 09 04:42:56.791477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 244/493] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:42:58.805490 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-62bbbbbc-f314-4134-b522-ec76d8cd964f req-f2a15151-151f-43db-a8d2-72e9b1dd8664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b697ec-4fe5-4eb3-95c9-6890c141915b", "tag": "e2bb2333-df06-4b43-a41b-37e81ef693cb"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:42:58.810873 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=58 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:42:58.817244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-62bbbbbc-f314-4134-b522-ec76d8cd964f req-f2a15151-151f-43db-a8d2-72e9b1dd8664 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:42:58.817756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-62bbbbbc-f314-4134-b522-ec76d8cd964f req-f2a15151-151f-43db-a8d2-72e9b1dd8664 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:42:58.818183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-62bbbbbc-f314-4134-b522-ec76d8cd964f req-f2a15151-151f-43db-a8d2-72e9b1dd8664 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:42:58.829204 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-62bbbbbc-f314-4134-b522-ec76d8cd964f req-f2a15151-151f-43db-a8d2-72e9b1dd8664 service nova] Creating event network-changed:e2bb2333-df06-4b43-a41b-37e81ef693cb for instance 81b697ec-4fe5-4eb3-95c9-6890c141915b on hv-cinder-85600 Sep 09 04:42:58.834051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-62bbbbbc-f314-4134-b522-ec76d8cd964f req-f2a15151-151f-43db-a8d2-72e9b1dd8664 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032858 Sep 09 04:42:58.834613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 250/494] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:10.413931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:10.414490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:10.416846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=37 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:10.418100 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=4 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:10.423736 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:10.424212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:10.424643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:10.425358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:10.425806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:10.426225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:10.456513 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2839fc83-496a-4555-adf8-c3c919e0107a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments/71a551a3-7836-4bc8-b177-40855a6fd9d6" status: 200 len: 194 microversion: 2.20 time: 0.046865 Sep 09 04:43:10.457077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 245/495] 10.222.0.20 () {60 vars in 1454 bytes} [Fri Sep 9 04:43:10 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments/71a551a3-7836-4bc8-b177-40855a6fd9d6 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:43:10.522322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:10.523025 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=76 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:10.528637 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:10.529218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:10.535989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:10.536469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:10.536899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:10.537585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:10.538032 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:10.538451 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:10.619406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lazy-loading 'services' on Instance uuid 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:10.692727 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3f277890-ef8d-4546-b9b2-a729d22f3c9a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments/71a551a3-7836-4bc8-b177-40855a6fd9d6" status: 202 len: 0 microversion: 2.20 time: 0.171765 Sep 09 04:43:10.693335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 251/496] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Sep 9 04:43:10 2022] DELETE /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments/71a551a3-7836-4bc8-b177-40855a6fd9d6 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:43:10.702331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:10.704793 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:10.710493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:10.711007 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:10.711436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:10.712129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:10.712575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:10.712993 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:10.742658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-47f28a6f-3e27-413d-af4c-3b143d7be6d1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044736 Sep 09 04:43:10.743424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 246/497] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 04:43:10 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:43:11.756879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:11.759508 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:11.765939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:11.766483 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:11.766915 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:11.767657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:11.768110 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:11.768531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:11.798782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-df0bb1aa-1b00-4254-a45c-c1d3f7d2ba48 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047080 Sep 09 04:43:11.799646 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 252/498] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 04:43:11 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:43:12.811655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:12.813766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:12.820480 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:12.820962 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:12.821400 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:12.822086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:12.822537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:12.822978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:12.851294 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0688b4d8-5e3a-47fa-b3ed-d280f4ccaa31 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044098 Sep 09 04:43:12.851837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 247/499] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 04:43:12 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:12.913840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:12.914332 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:12.921169 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:12.921643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:12.922077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:12.922756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:12.923237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:12.923653 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:12.948500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:43:13.021927 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-315b108c-a261-4d71-b172-d9c4dc652047 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 204 len: 0 microversion: 2.20 time: 0.111631 Sep 09 04:43:13.022516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 253/500] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 04:43:12 2022] DELETE /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 04:43:13.030763 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:13.031445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:13.037724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:13.038199 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:13.038633 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:13.039350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:13.039798 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:13.040218 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:13.170388 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:13.178440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:13.179914 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:13.181073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c3526e25-bb89-4deb-9232-1b908e6cbaae tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.154219 Sep 09 04:43:13.181622 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 248/501] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:13 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:14.207862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:14.208555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:14.214860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:14.215370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:14.215802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:14.216490 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:14.216940 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:14.217364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:14.350540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:14.359255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:14.360696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:14.361840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0c40339a-1285-4eeb-93a8-0e54963e6287 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.158286 Sep 09 04:43:14.362395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 254/502] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:14 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:15.388254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:15.388886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:15.395151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:15.395631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:15.396063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:15.396759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:15.397279 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:15.397646 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:15.607757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:15.616092 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:15.617526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:15.618689 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4bab9e5f-07f7-44d9-b53c-0cf226d7516c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1723 microversion: 2.20 time: 0.234353 Sep 09 04:43:15.619541 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 249/503] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:15 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:15.989086 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-bf697599-958b-4986-8d98-3e83b228af0a req-ba2fb411-99c9-49ab-9440-8742513b09e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e", "name": "network-vif-deleted", "tag": "4024da04-efc2-4a91-b9ed-e97cc0ac1f78"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:16.001461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bf697599-958b-4986-8d98-3e83b228af0a req-ba2fb411-99c9-49ab-9440-8742513b09e5 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:16.001943 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bf697599-958b-4986-8d98-3e83b228af0a req-ba2fb411-99c9-49ab-9440-8742513b09e5 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:16.002368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bf697599-958b-4986-8d98-3e83b228af0a req-ba2fb411-99c9-49ab-9440-8742513b09e5 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:16.014613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-bf697599-958b-4986-8d98-3e83b228af0a req-ba2fb411-99c9-49ab-9440-8742513b09e5 service nova] Creating event network-vif-deleted:4024da04-efc2-4a91-b9ed-e97cc0ac1f78 for instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e on hv-cinder-85600 Sep 09 04:43:16.019762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-bf697599-958b-4986-8d98-3e83b228af0a req-ba2fb411-99c9-49ab-9440-8742513b09e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035108 Sep 09 04:43:16.020439 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 255/504] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:16.643934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:16.645340 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:16.654346 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:16.655111 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:16.655617 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:16.656245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:16.656701 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:16.657123 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:16.691763 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:16.692248 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:16.692679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:16.693317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lazy-loading 'fault' on Instance uuid 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:16.742283 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:16.755977 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:16.758086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:16.760140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9b63294e-c53e-4894-86a6-a263ca0488d9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 200 len: 1371 microversion: 2.20 time: 0.119275 Sep 09 04:43:16.776594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 250/505] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:16 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:17.614712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:17.615938 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:17.622278 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.622756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.623216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.623907 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.624358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.624782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.648279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9fdabd46-1b2d-437f-8992-265ac8e413d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599/ips" status: 200 len: 151 microversion: 2.1 time: 0.038393 Sep 09 04:43:17.650076 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 256/506] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:43:17 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:17.661295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebafd939-adb2-4261-b497-6bbac22a3cd4"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:17.663651 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:17.669899 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.670373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.670804 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.671518 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.671964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.672382 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.749415 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Invalid volume: volume ebafd939-adb2-4261-b497-6bbac22a3cd4 is already attached to instances: 78e092d2-0c03-4288-be1b-f0f2da7f5de2 Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: POST /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599/os-volume_attachments HTTP/1.1 Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 74 Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:43:17.751147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {"volumeAttachment": {"volumeId": "ebafd939-adb2-4261-b497-6bbac22a3cd4"}} Sep 09 04:43:17.752696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Invalid volume: volume ebafd939-adb2-4261-b497-6bbac22a3cd4 is already attached to instances: 78e092d2-0c03-4288-be1b-f0f2da7f5de2 Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'server_id': '4491bf38-2476-4d98-81a8-4d82393cc599', 'body': {'volumeAttachment': {'volumeId': 'ebafd939-adb2-4261-b497-6bbac22a3cd4'}}} Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ebafd939-adb2-4261-b497-6bbac22a3cd4 is already attached to instances: 78e092d2-0c03-4288-be1b-f0f2da7f5de2 Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.753589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ebafd939-adb2-4261-b497-6bbac22a3cd4 is already attached to instances: 78e092d2-0c03-4288-be1b-f0f2da7f5de2 Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:17.754951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ebafd939-adb2-4261-b497-6bbac22a3cd4 is already attached to instances: 78e092d2-0c03-4288-be1b-f0f2da7f5de2 Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 400 to user: Invalid volume: volume ebafd939-adb2-4261-b497-6bbac22a3cd4 is already attached to instances: 78e092d2-0c03-4288-be1b-f0f2da7f5de2 {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-663ca355-63b7-446c-88ff-65e249e82dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095266 Sep 09 04:43:17.756290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 251/507] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:43:17 2022] POST /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:43:17.761899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:17.762397 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:17.768292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.768775 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.769211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.769899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.770350 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.770774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.787697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:17.788300 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:17.794728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.795231 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.795666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:43:17.795790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.796354 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.796801 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.797227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.810604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] HTTP exception thrown: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Request method failure captured: Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e HTTP/1.1 Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNuan7TnuH7wGoBX7V6FPvGY8kbR7Jg1f6C2ofK76870JAeqqAEWFv8D1iZtkA_QsXhSPercQjuioLJc2tovFRM1hDwQ1cHXrioEiuU9uXG_ZpK5UJBlIBvwYr2vgRDtgr3wBEbgIgZphSVaXGfTLlW1nvNmZX1o3Cyt7OjzEzMJaA Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:43:17.812185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}] Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: befee01f638c4e7681b30c64acad6a6a Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:43:17.813920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e'} Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:17.814811 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:43:17.816320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:17.817496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Returning 404 to user: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:17.817496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-66a03cff-7404-46aa-887c-6a88e44c7970 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 404 len: 111 microversion: 2.20 time: 0.029688 Sep 09 04:43:17.817496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 252/508] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:17 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 04:43:17.822155 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bf65c565-793d-4f5e-b28c-f1daf1ac3b09 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '.version_select at 0x7f43faee6f70>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:17.842613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bf65c565-793d-4f5e-b28c-f1daf1ac3b09 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845498393" status: 204 len: 0 microversion: 2.20 time: 0.023855 Sep 09 04:43:17.843134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 253/509] 10.222.0.20 () {60 vars in 1259 bytes} [Fri Sep 9 04:43:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845498393 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 04:43:17.875788 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fb616121-be57-40c6-a25e-c118fb69ff7a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 204 len: 0 microversion: 2.1 time: 0.117795 Sep 09 04:43:17.878986 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 257/510] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:43:17 2022] DELETE /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:43:17.886770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:17.887414 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:17.894746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.895261 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.895698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:17.896396 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:17.896841 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:17.897265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:18.078058 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:18.093576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-60a87462-3aa5-41b8-b569-b387fb91cc58 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1683 microversion: 2.1 time: 0.212335 Sep 09 04:43:18.100945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 254/511] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:17 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:18.554427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9ddb71e6-7dde-4924-927a-78f7b01989c1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'create', calling method: .version_select at 0x7f43faedf550>, body: {"keypair": {"name": "tempest-keypair-1778018958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBLt9vtYKV9n3muMbFGyuGcM0H74gCID30ZBW1DbTgbo4zxT8SsL0h6PDjmx61IeOQZmH+h7dhKNnPpfFfwlHu2og/KnQN0xrfjKm1W2wAp1GHHQ0cMTX0SC7pZK4Qu4A=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:18.569633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-9ddb71e6-7dde-4924-927a-78f7b01989c1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:43:18.573418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-9ddb71e6-7dde-4924-927a-78f7b01989c1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for user befee01f638c4e7681b30c64acad6a6a and project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:43:18.595319 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9ddb71e6-7dde-4924-927a-78f7b01989c1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045138 Sep 09 04:43:18.595910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 258/512] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Sep 9 04:43:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 04:43:19.116809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:19.117556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:19.124036 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:19.124596 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:19.125031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:19.125724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:19.126169 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:19.126586 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:19.342877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:19.350553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d79e5f61-1336-427a-87b5-5d954d868673 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1683 microversion: 2.1 time: 0.237612 Sep 09 04:43:19.351146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 255/513] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:19 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:20.298920 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1239417970", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be4e0000-0b0b-4f80-80d3-91d027df1d63"}], "security_groups": [{"name": "tempest-securitygroup--1280832094"}], "key_name": "tempest-keypair-1778018958", "user_data": "}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:20.373475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:20.374181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:20.380891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:20.381371 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:20.381814 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:20.382618 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:20.383114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:20.383545 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:20.495937 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] validate_networks() for [('be4e0000-0b0b-4f80-80d3-91d027df1d63', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:43:20.660714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:20.668296 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bc5e8c60-4a48-4855-9740-a8cd6d8c2026 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1683 microversion: 2.1 time: 0.298749 Sep 09 04:43:20.668857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 256/514] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:20 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1683 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:21.111931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:21.114128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:21.121751 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.122291 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.122726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.123703 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.123963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.124709 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.168184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b27e27a5-4602-4ede-a832-391310df42ab tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060832 Sep 09 04:43:21.170170 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 257/515] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:43:21 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 04:43:21.216220 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:43:21.217144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:43:21.218133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:43:21.218651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:43:21.219326 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:43:21.233692 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.234307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.234986 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.236077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.236605 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.237482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.256112 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:21.261590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:21.277847 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.278308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.278744 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.286331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.286821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.287277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.291633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:43:21.300289 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Getting quotas for user befee01f638c4e7681b30c64acad6a6a and project 5176b458a4a8481eaa37d8693b51f15e. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:43:21.316454 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:43:21.320288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:43:21.348724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:43:21.440028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5fa85d0c-983e-42be-b4c9-69f97e822cdf tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.145881 Sep 09 04:43:21.447462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 259/516] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Sep 9 04:43:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 04:43:21.455393 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-9e904775-8fd2-45b9-9e5b-19b8d22db89c req-09ddaf99-ef9f-44df-b2f9-f30930130933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4491bf38-2476-4d98-81a8-4d82393cc599", "name": "network-vif-deleted", "tag": "b3446042-9774-408b-aa51-4ba658c97b30"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:21.487566 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-9e904775-8fd2-45b9-9e5b-19b8d22db89c req-09ddaf99-ef9f-44df-b2f9-f30930130933 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.488114 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-9e904775-8fd2-45b9-9e5b-19b8d22db89c req-09ddaf99-ef9f-44df-b2f9-f30930130933 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.488762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-9e904775-8fd2-45b9-9e5b-19b8d22db89c req-09ddaf99-ef9f-44df-b2f9-f30930130933 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.516885 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-9e904775-8fd2-45b9-9e5b-19b8d22db89c req-09ddaf99-ef9f-44df-b2f9-f30930130933 service nova] Creating event network-vif-deleted:b3446042-9774-408b-aa51-4ba658c97b30 for instance 4491bf38-2476-4d98-81a8-4d82393cc599 on hv-cinder-85600 Sep 09 04:43:21.522082 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-9e904775-8fd2-45b9-9e5b-19b8d22db89c req-09ddaf99-ef9f-44df-b2f9-f30930130933 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073318 Sep 09 04:43:21.523169 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 260/517] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:21.529218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3c546f41-fb2e-4986-b5e2-1bb3e5ea818e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:21.530026 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3c546f41-fb2e-4986-b5e2-1bb3e5ea818e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:21.550481 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-01f9d496-edcc-4c05-8cf7-b159e3516e23 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 204 len: 0 microversion: 2.1 time: 0.307412 Sep 09 04:43:21.551856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 258/518] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:43:21 2022] DELETE /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:43:21.560614 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:21.565992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:21.576063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.577031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.578146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.580609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.581231 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.582432 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.597901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3c546f41-fb2e-4986-b5e2-1bb3e5ea818e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:21.611296 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3c546f41-fb2e-4986-b5e2-1bb3e5ea818e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:21.612762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3c546f41-fb2e-4986-b5e2-1bb3e5ea818e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:21.614987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3c546f41-fb2e-4986-b5e2-1bb3e5ea818e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1282 microversion: 2.20 time: 0.089630 Sep 09 04:43:21.631005 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 261/519] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:21 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:21.692068 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:21.692671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:21.699902 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.700380 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.700879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.702028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.702028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.702418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.740803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:21.741298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:21.741728 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:21.742230 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'fault' on Instance uuid 4491bf38-2476-4d98-81a8-4d82393cc599 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:21.751795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:21.761787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-70d18aa2-5f24-4ef5-84f9-da3171e78ab1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1673 microversion: 2.1 time: 0.205460 Sep 09 04:43:21.782012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 259/520] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:21 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:21.806703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:21.815596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cd6037b9-9c65-43cd-bcba-46ff03a3e0a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1332 microversion: 2.1 time: 0.127432 Sep 09 04:43:21.818971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 262/521] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:21 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:22.641847 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:22.642457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:22.649177 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:22.649599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:22.650037 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:22.650734 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:22.651218 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:22.652310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:22.712791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:22.720766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:22.722221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:22.723350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-efe21d23-82a8-4fb6-acd3-59ad146dd28f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1286 microversion: 2.20 time: 0.085433 Sep 09 04:43:22.723900 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 260/522] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:22 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:22.786044 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:22.786583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:22.793523 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:22.794003 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:22.794435 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:22.795168 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:22.795616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:22.796035 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:22.838837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:22.839466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:22.845271 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:22.845746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:22.846176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:22.846867 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:22.847416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:22.847838 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:22.851818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:22.881438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:22.881926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:22.882359 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:22.882803 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'fault' on Instance uuid 4491bf38-2476-4d98-81a8-4d82393cc599 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:22.933025 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:22.940956 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3eec50cb-38bc-4b45-a920-4708f56d04e5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1332 microversion: 2.1 time: 0.105596 Sep 09 04:43:22.941515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 261/523] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:22 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:22.954399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:22.962085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9289e359-c23f-4260-b474-257c28a003f8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1673 microversion: 2.1 time: 0.180034 Sep 09 04:43:22.962649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 263/524] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:22 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:23.748759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:23.749370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:23.755663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:23.756139 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:23.756566 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:23.757254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:23.757698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:23.758116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:23.819311 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:23.827832 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:23.829266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:23.830350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8a73c30f-6cdb-4dd3-b5e6-98e814f6fb3c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1278 microversion: 2.20 time: 0.085730 Sep 09 04:43:23.830898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 262/525] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:23 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:23.963476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:23.964237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:23.970674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:23.971281 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:23.971724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:23.972411 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:23.972857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:23.973276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:23.985391 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:23.985891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:23.992040 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:23.992527 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:23.993245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:23.994132 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:23.994595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:23.995562 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:24.006266 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:24.006828 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:24.007358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:24.007876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'fault' on Instance uuid 4491bf38-2476-4d98-81a8-4d82393cc599 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:24.102161 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:24.109718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-806703dc-0a04-48a3-bfec-478ccd702971 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 200 len: 1332 microversion: 2.1 time: 0.150084 Sep 09 04:43:24.110374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 264/526] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:23 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 1332 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:24.235613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:24.243649 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-760679f5-ab0b-49b8-99a5-5b65019d232c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1673 microversion: 2.1 time: 0.262151 Sep 09 04:43:24.244219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 263/527] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:23 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:24.807870 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-0b5103d9-c082-4543-a2e2-8585cf76e2c6 req-2ead036b-6297-4af1-ba02-08d87efcbedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee805de-a9e3-4596-9b43-d7cdc17b9e96", "name": "network-vif-deleted", "tag": "7f751c26-39f9-4ccf-bac7-cc25e0b849e4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:24.817889 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-0b5103d9-c082-4543-a2e2-8585cf76e2c6 req-2ead036b-6297-4af1-ba02-08d87efcbedc service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:24.818416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-0b5103d9-c082-4543-a2e2-8585cf76e2c6 req-2ead036b-6297-4af1-ba02-08d87efcbedc service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:24.818851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-0b5103d9-c082-4543-a2e2-8585cf76e2c6 req-2ead036b-6297-4af1-ba02-08d87efcbedc service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:24.829590 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-0b5103d9-c082-4543-a2e2-8585cf76e2c6 req-2ead036b-6297-4af1-ba02-08d87efcbedc service nova] Creating event network-vif-deleted:7f751c26-39f9-4ccf-bac7-cc25e0b849e4 for instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 on hv-cinder-85600 Sep 09 04:43:24.834447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-0b5103d9-c082-4543-a2e2-8585cf76e2c6 req-2ead036b-6297-4af1-ba02-08d87efcbedc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030335 Sep 09 04:43:24.835074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 265/528] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:24.855674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:24.856284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:24.863021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:24.863469 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:24.863914 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:24.864625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:24.865083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:24.865689 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:24.950019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:24.962384 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:24.966376 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:24.967802 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3d11b5b0-ce5e-474f-82e3-78771ce278b4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1334 microversion: 2.20 time: 0.116646 Sep 09 04:43:24.983349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 264/529] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:24 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1334 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:25.133506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:25.134215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:25.143235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:25.144055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:25.144653 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:25.145518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:25.146886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:25.147643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:25.173217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 HTTP/1.1 Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:43:25.177095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:43:25.178714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '4491bf38-2476-4d98-81a8-4d82393cc599'} Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:25.179651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:43:25.181104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:25.187534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:25.188635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-09b4c985-e3c7-4210-afc4-a40fbcec8cd6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 404 len: 111 microversion: 2.1 time: 0.059860 Sep 09 04:43:25.193135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 266/530] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:25 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:43:25.200312 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1d2621a2-0c6c-43f1-be96-4abdfdaa07b1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '.version_select at 0x7f43facb2820>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:25.232329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1d2621a2-0c6c-43f1-be96-4abdfdaa07b1 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705989547" status: 202 len: 0 microversion: 2.1 time: 0.036686 Sep 09 04:43:25.242495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 265/531] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Sep 9 04:43:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705989547 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:43:25.268407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:25.269015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:25.276672 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:25.276783 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:25.277261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:25.277819 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:25.278704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:25.279407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:25.327075 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:25.327800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:25.328417 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:25.329011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lazy-loading 'fault' on Instance uuid 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:25.399233 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:25.407802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-22742637-340d-4150-9235-c157bbdef8c5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 200 len: 1326 microversion: 2.1 time: 0.143151 Sep 09 04:43:25.408491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 267/532] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:25 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 1326 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:25.993700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:25.994531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:26.003407 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.004560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.005068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.005885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.006682 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.007210 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.126034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:26.134173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:26.135730 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:26.136930 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ce7b3fdd-6c1d-48fe-9f7b-adc279abda05 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1340 microversion: 2.20 time: 0.147783 Sep 09 04:43:26.137559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 266/533] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:25 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1340 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:43:26.334997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:26.335539 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:26.342391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.342890 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.343369 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.344080 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.344541 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.344974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.349312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:26.431969 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:26.432613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:26.438572 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.439282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.439875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.441200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.441662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.442082 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.450178 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'services' on Instance uuid 78e092d2-0c03-4288-be1b-f0f2da7f5de2 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:26.457397 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] HTTP exception thrown: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Request method failure captured: Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 HTTP/1.1 Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNxnzEjA1VfLDpIT81mdfxqrqWwnMh-yxCKpbHJgfsoeGF6-6A--Vpr_spmhEy9SikXzV6Z7cO-KG1zkajzozvtxYInBVc8Qd-ln7VOeT95VTY5A-SPU4y80qVVk0dx56S7jbG8OdBNja1vnF5Z-_OYp8qhpfp7VgsgiJWUTVajfFs Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:43:26.459375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}] Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: bf68e214fd4740be96f2d6c4325f6ee9 Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:43:26.460881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '4ee805de-a9e3-4596-9b43-d7cdc17b9e96'} Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:26.461808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:43:26.463295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:43:26.466563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Returning 404 to user: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:26.467795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a457cf63-ecc8-4a06-a73e-a5bad8b4d72c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 404 len: 111 microversion: 2.1 time: 0.039468 Sep 09 04:43:26.468842 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 267/534] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:26 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:43:26.477094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-877ed1f7-3f50-47b0-9f6e-de309c012d56 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '.version_select at 0x7f43facb2550>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:26.499088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-877ed1f7-3f50-47b0-9f6e-de309c012d56 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646859934" status: 202 len: 0 microversion: 2.1 time: 0.025566 Sep 09 04:43:26.504581 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 268/535] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 04:43:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646859934 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:43:26.551144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e5aa8068-e961-4fcf-8bb2-c6efcacd1873 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments/ebafd939-adb2-4261-b497-6bbac22a3cd4" status: 202 len: 0 microversion: 2.1 time: 0.219868 Sep 09 04:43:26.551744 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 268/536] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:43:26 2022] DELETE /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments/ebafd939-adb2-4261-b497-6bbac22a3cd4 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:43:26.560895 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:26.564066 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:26.575884 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.576743 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.577530 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.578435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:26.579089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:26.580090 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:26.616360 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-55092499-a5f3-4229-95ea-0eeef56ae9e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059950 Sep 09 04:43:26.621455 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 269/537] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:43:26 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:27.164169 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:27.165683 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:27.172896 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.174026 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.174539 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.175452 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.175958 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.176385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.342641 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fccaf39f-8085-4e4b-841c-a9e21def5527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'create', calling method: .version_select at 0x7f43fad29ee0>, body: {"keypair": {"name": "tempest-keypair-488817362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvrpgoq7zDMlP1Xw7oHdqTTCEv5avPx/YgwfBNbGR2WlFqULVGJySCyfn5sUv6dk5Uj1m0pcbbCLikjkcoJo8ZFL+ISM5IhtHSiioq0BZTJfUGfvzGTTk4RE7CSAiq0fA=="}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:27.360395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-fccaf39f-8085-4e4b-841c-a9e21def5527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:43:27.364373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-fccaf39f-8085-4e4b-841c-a9e21def5527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for user bf68e214fd4740be96f2d6c4325f6ee9 and project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:43:27.388518 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fccaf39f-8085-4e4b-841c-a9e21def5527 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049577 Sep 09 04:43:27.389120 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 270/538] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:43:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:43:27.442797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:27.451732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:27.453182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:27.454520 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5c471295-60e6-4bff-9e3c-8db2663d47ab tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1408 microversion: 2.20 time: 0.296632 Sep 09 04:43:27.455293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 269/539] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:27 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:27.608151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-156e9942-82a9-43d3-90b1-2197fed70d9f req-166e835f-d695-4534-bb5b-2e31f2ba655c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88adb310-4be0-4b55-a3f9-65fe75a17959", "tag": "ffb258f4-dc03-4824-b22c-0f1742f0ed65"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:27.629313 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:27.631936 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:27.632088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-156e9942-82a9-43d3-90b1-2197fed70d9f req-166e835f-d695-4534-bb5b-2e31f2ba655c service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.632734 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-156e9942-82a9-43d3-90b1-2197fed70d9f req-166e835f-d695-4534-bb5b-2e31f2ba655c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.633273 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-156e9942-82a9-43d3-90b1-2197fed70d9f req-166e835f-d695-4534-bb5b-2e31f2ba655c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.643432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.644234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.644915 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.646493 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.647186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.647849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.663521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-156e9942-82a9-43d3-90b1-2197fed70d9f req-166e835f-d695-4534-bb5b-2e31f2ba655c service nova] Creating event network-changed:ffb258f4-dc03-4824-b22c-0f1742f0ed65 for instance 88adb310-4be0-4b55-a3f9-65fe75a17959 on hv-cinder-85600 Sep 09 04:43:27.669878 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-156e9942-82a9-43d3-90b1-2197fed70d9f req-166e835f-d695-4534-bb5b-2e31f2ba655c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072701 Sep 09 04:43:27.670724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 271/540] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:43:27.691519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-00cfdab1-0c44-4abe-8590-0ed3407f8fc8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065241 Sep 09 04:43:27.693131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 270/541] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:43:27 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 04:43:27.763752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:27.764501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:27.770861 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.771558 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.772097 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.773079 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.773636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.774185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.800528 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:43:27.897731 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8432dc36-884f-4df8-a85b-d01af5525111 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 204 len: 0 microversion: 2.1 time: 0.138996 Sep 09 04:43:27.898753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 272/542] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:43:27 2022] DELETE /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:43:27.907596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:27.908203 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:27.913948 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.914427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.914859 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:27.917106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:27.917563 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:27.917985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:28.083181 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:28.091147 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f7477374-59fb-4e0e-939d-7e27e63d1ffc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1681 microversion: 2.1 time: 0.187391 Sep 09 04:43:28.091714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 271/543] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:27 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:28.481114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:28.481821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:28.488468 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:28.488958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:28.489395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:28.490101 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:28.490553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:28.490999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:28.623195 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:28.631551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:28.633013 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:28.634121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c4adf2a9-9aba-4abf-a4f8-ecc57b46899a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1408 microversion: 2.20 time: 0.157931 Sep 09 04:43:28.634706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 273/544] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:28 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:28.922062 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-505533115", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da245dda-2c01-4deb-aa23-3957c02d97c0"}], "security_groups": [{"name": "tempest-securitygroup--1548276568"}], "key_name": "tempest-keypair-488817362", "user_data": "}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:29.028977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] validate_networks() for [('da245dda-2c01-4deb-aa23-3957c02d97c0', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:43:29.115519 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:29.116047 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:29.121901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:29.122382 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:29.122846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:29.123630 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:29.124082 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:29.124505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:29.372756 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:29.380447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-45f4b55a-1012-4f9c-81f5-83177dc9d326 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1681 microversion: 2.1 time: 0.268867 Sep 09 04:43:29.381012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 274/545] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:29 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:29.548494 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:43:29.548922 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:43:29.549433 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:43:29.549842 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:43:29.550283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:43:29.559103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:29.559593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:29.560031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:29.560762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:29.561220 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:29.561647 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:29.579809 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:43:29.584210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Getting quotas for user bf68e214fd4740be96f2d6c4325f6ee9 and project 7ad09c9b062641c19d3811d5c96a24f8. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:43:29.586748 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:29.598250 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:43:29.600584 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:43:29.648612 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b72d39dc-a4c3-4ba8-b27d-d8e1fbb6784f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.730688 Sep 09 04:43:29.649271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 272/546] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:43:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:43:29.660874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:29.661209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3850b12f-38fc-42ad-843d-094a8742105c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:29.661691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:29.661999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3850b12f-38fc-42ad-843d-094a8742105c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:29.668502 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:29.669649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:29.669649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:29.670305 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:29.670757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:29.671199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:29.752050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3850b12f-38fc-42ad-843d-094a8742105c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:29.761678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3850b12f-38fc-42ad-843d-094a8742105c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1236 microversion: 2.1 time: 0.104543 Sep 09 04:43:29.762498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 275/547] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:29 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1236 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:29.824348 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:29.832564 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:29.834115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:29.835425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7706c4f9-d649-4e76-ae19-5f5fea242a52 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1408 microversion: 2.20 time: 0.178268 Sep 09 04:43:29.836064 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 273/548] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:29 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:30.404214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:30.404824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:30.413172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:30.413649 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:30.414081 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:30.414759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:30.415235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:30.415656 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:30.544843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:30.552506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6656d7f4-5f8c-481b-bad3-757b6da59385 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1681 microversion: 2.1 time: 0.152174 Sep 09 04:43:30.553067 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 276/549] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:30 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:30.784976 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:30.785866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:30.793577 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:30.794367 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:30.795498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:30.796621 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:30.797344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:30.797861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:30.861774 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:30.863344 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:30.869649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:30.871428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:30.874281 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:30.874910 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:30.875642 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:30.876457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:30.876909 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:30.877583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:30.879413 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-295cfcd8-1e57-467a-b161-0e0f0119a8bc tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1288 microversion: 2.1 time: 0.098408 Sep 09 04:43:30.880687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 274/550] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:30 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:31.109358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:31.119454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:31.121785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:31.122920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f56295a4-f553-4790-a865-48b24b5812d8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1408 microversion: 2.20 time: 0.265931 Sep 09 04:43:31.123505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 277/551] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:30 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:31.541150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-d6557f06-b54f-43b8-bf94-cb683b6632c7 req-bf0c9fbd-659b-4ade-b8e9-247564883d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e092d2-0c03-4288-be1b-f0f2da7f5de2", "name": "network-vif-deleted", "tag": "3478642f-a083-41dc-8630-0f933d8c0ed9"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:31.566100 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d6557f06-b54f-43b8-bf94-cb683b6632c7 req-bf0c9fbd-659b-4ade-b8e9-247564883d99 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:31.566613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d6557f06-b54f-43b8-bf94-cb683b6632c7 req-bf0c9fbd-659b-4ade-b8e9-247564883d99 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:31.567136 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d6557f06-b54f-43b8-bf94-cb683b6632c7 req-bf0c9fbd-659b-4ade-b8e9-247564883d99 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:31.576746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:31.577414 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:31.594308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:31.607001 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:31.607466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:31.608254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:31.613346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-d6557f06-b54f-43b8-bf94-cb683b6632c7 req-bf0c9fbd-659b-4ade-b8e9-247564883d99 service nova] Creating event network-vif-deleted:3478642f-a083-41dc-8630-0f933d8c0ed9 for instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 on hv-cinder-85600 Sep 09 04:43:31.617140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:31.617784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:31.632761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-d6557f06-b54f-43b8-bf94-cb683b6632c7 req-bf0c9fbd-659b-4ade-b8e9-247564883d99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101896 Sep 09 04:43:31.633553 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 275/552] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:31.718806 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:31.727529 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d03126da-1df0-45a4-b0ee-665004c4cd7d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 200 len: 1326 microversion: 2.1 time: 0.155663 Sep 09 04:43:31.739663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 278/553] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:31 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:31.910384 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:31.911197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:31.932342 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:31.932815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:31.933376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:31.934205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:31.934519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:31.934875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:32.020343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:32.030437 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-80ffbd75-b007-4f9c-a990-a7e77eca89c9 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1294 microversion: 2.1 time: 0.124276 Sep 09 04:43:32.031587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 276/554] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:31 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:32.147613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:32.148401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:32.155137 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:32.155818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:32.156357 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:32.157180 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:32.157787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:32.158322 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:32.397787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:32.406536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:32.408029 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:32.409155 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6edd7a20-f0a2-4324-ae53-df29362a6cd5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1408 microversion: 2.20 time: 0.265629 Sep 09 04:43:32.426833 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 279/555] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:32 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:32.751968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:32.752877 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:32.761244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:32.762082 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:32.762804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:32.763893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:32.764503 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:32.765251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:32.783732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 HTTP/1.1 Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:43:32.786014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:43:32.787461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '78e092d2-0c03-4288-be1b-f0f2da7f5de2'} Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:32.788333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:43:32.789766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:32.790956 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:32.790956 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8634a3fe-0f72-4293-9e21-04e046a27d2b tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 404 len: 111 microversion: 2.1 time: 0.039402 Sep 09 04:43:32.792678 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 277/556] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:32 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:43:32.798722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-81f21cd3-17af-4a40-ab0f-011e343836d3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '.version_select at 0x7f43fad8ef70>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:32.818706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-81f21cd3-17af-4a40-ab0f-011e343836d3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094070471" status: 202 len: 0 microversion: 2.1 time: 0.024283 Sep 09 04:43:32.819322 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 280/557] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Sep 9 04:43:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094070471 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:43:33.054535 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:33.055178 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:33.061989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:33.062482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:33.063143 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:33.064030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:33.064720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:33.065308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:33.295445 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:33.306598 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a1bfddab-c44e-4217-b5d2-f384fb7dbb49 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.256252 Sep 09 04:43:33.324092 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 278/558] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:33 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:33.437800 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:33.439861 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:33.448520 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:33.449585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:33.450242 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:33.451497 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:33.452021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:33.452659 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:33.462428 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-3e0c11cd-7c3e-4be9-a55e-0152474bdc90 req-dbf17988-1dea-4281-9fef-1e56ee0a3095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51d5f24-f47e-4dd9-9948-81bfa8ed97dc", "tag": "a3fff027-2bdc-4c7e-a679-5b611770f4c2"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:33.485478 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3e0c11cd-7c3e-4be9-a55e-0152474bdc90 req-dbf17988-1dea-4281-9fef-1e56ee0a3095 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:33.486047 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3e0c11cd-7c3e-4be9-a55e-0152474bdc90 req-dbf17988-1dea-4281-9fef-1e56ee0a3095 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:33.488218 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3e0c11cd-7c3e-4be9-a55e-0152474bdc90 req-dbf17988-1dea-4281-9fef-1e56ee0a3095 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:33.507751 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-3e0c11cd-7c3e-4be9-a55e-0152474bdc90 req-dbf17988-1dea-4281-9fef-1e56ee0a3095 service nova] Creating event network-changed:a3fff027-2bdc-4c7e-a679-5b611770f4c2 for instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc on hv-cinder-85600 Sep 09 04:43:33.521864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-3e0c11cd-7c3e-4be9-a55e-0152474bdc90 req-dbf17988-1dea-4281-9fef-1e56ee0a3095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064319 Sep 09 04:43:33.525175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 279/559] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:33.530960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-de26d790-21e5-4cda-ae03-7ed6c5945b6a req-eb30ba81-0677-43b4-96d0-2005b8287587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88adb310-4be0-4b55-a3f9-65fe75a17959", "name": "network-vif-plugged", "status": "completed", "tag": "ffb258f4-dc03-4824-b22c-0f1742f0ed65"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:33.541777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-de26d790-21e5-4cda-ae03-7ed6c5945b6a req-eb30ba81-0677-43b4-96d0-2005b8287587 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:33.542228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-de26d790-21e5-4cda-ae03-7ed6c5945b6a req-eb30ba81-0677-43b4-96d0-2005b8287587 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:33.542856 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-de26d790-21e5-4cda-ae03-7ed6c5945b6a req-eb30ba81-0677-43b4-96d0-2005b8287587 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:33.563391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-de26d790-21e5-4cda-ae03-7ed6c5945b6a req-eb30ba81-0677-43b4-96d0-2005b8287587 service nova] Creating event network-vif-plugged:ffb258f4-dc03-4824-b22c-0f1742f0ed65 for instance 88adb310-4be0-4b55-a3f9-65fe75a17959 on hv-cinder-85600 Sep 09 04:43:33.579647 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-de26d790-21e5-4cda-ae03-7ed6c5945b6a req-eb30ba81-0677-43b4-96d0-2005b8287587 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047757 Sep 09 04:43:33.580562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 280/560] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:33.586014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fa0a8b2b-f103-4c43-b813-6deb161b4b0e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: .version_select at 0x7f43fad3ab80>, body: {"keypair": {"name": "tempest-keypair-213649908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3uvNQW0Huk3UEVaqCu+2zvAWHr8qSkNx+MvIRw7Pg46r6KPxkfpnp3PUL6bDIIukypC6hOBzfX2sCqBNtwQNdjWcEU5mzVt8sHw4HjFh3ixin5+w1cFhhH1OU9qzQc4A=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:33.603284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-fa0a8b2b-f103-4c43-b813-6deb161b4b0e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:43:33.607799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-fa0a8b2b-f103-4c43-b813-6deb161b4b0e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:43:33.632984 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fa0a8b2b-f103-4c43-b813-6deb161b4b0e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050943 Sep 09 04:43:33.634116 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 281/561] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:43:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:33.703412 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:33.714985 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:33.717156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:33.719024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3c79eed1-b24c-47dd-b50a-7ae5e06ab4a7 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1408 microversion: 2.20 time: 0.286133 Sep 09 04:43:33.721027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 281/562] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:33 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:34.330486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:34.331243 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:34.339123 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:34.339609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:34.340040 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:34.340815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:34.341264 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:34.341686 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:34.474489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:34.482811 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-552986cd-f4f0-42aa-88d4-0ad6e3fbdcf4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.156862 Sep 09 04:43:34.483592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 282/563] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:34 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:34.744746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:34.745810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:34.752619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:34.753103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:34.753537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:34.754235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:34.754680 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:34.755134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:34.759132 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:34.889369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:34.898369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:34.899915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:34.902153 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b535468e-65dd-46e5-9a1f-56a23b6e6489 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1408 microversion: 2.20 time: 0.161475 Sep 09 04:43:34.902839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 282/564] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:34 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:43:34.995431 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-489519453", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0"}], "security_groups": [{"name": "tempest-securitygroup--1295295443"}], "key_name": "tempest-keypair-213649908", "user_data": "}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:35.095368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] validate_networks() for [('38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:43:35.457028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:43:35.457624 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:43:35.457917 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:43:35.458356 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:43:35.458776 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:43:35.468154 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.468632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.469069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.469799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.470253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.470683 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.487114 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:43:35.491118 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:43:35.502413 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:43:35.504768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:43:35.507175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:35.507783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:35.514240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.514718 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.515188 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.515885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.516328 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.516744 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.554371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c67a8070-6d74-4cf5-bfc8-e521d484a158 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563148 Sep 09 04:43:35.555036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 283/565] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:43:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:43:35.567046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:35.567541 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:35.575911 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.577027 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.578617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.579825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.580434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.580875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.660134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:35.668537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-076b40d3-c11e-470d-b9b1-2aaa19ebf837 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.166499 Sep 09 04:43:35.669296 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 283/566] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:35 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:35.678202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-02c05dc6-7b7a-4839-94a2-07876ae99da0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:35.678972 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-02c05dc6-7b7a-4839-94a2-07876ae99da0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:35.713976 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lazy-loading 'services' on Instance uuid 81b697ec-4fe5-4eb3-95c9-6890c141915b {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:35.809188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e90fe3fe-3502-4275-af76-2a7eec921e43 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments/b050a325-e1aa-48eb-8256-4b37e1a8d00c" status: 202 len: 0 microversion: 2.1 time: 0.247032 Sep 09 04:43:35.809918 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 284/567] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:43:35 2022] DELETE /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments/b050a325-e1aa-48eb-8256-4b37e1a8d00c => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:43:35.819361 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:35.821997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:35.829196 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.829708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.830142 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.830853 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.831323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.831784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.866743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-278ee777-2591-4785-91d5-cfdde8acbd7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052151 Sep 09 04:43:35.871098 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 285/568] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:43:35 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:35.928515 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:35.929274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:35.935804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.936584 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.937170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:35.937937 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:35.938329 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:35.938748 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:36.036760 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-02c05dc6-7b7a-4839-94a2-07876ae99da0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:36.044608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-02c05dc6-7b7a-4839-94a2-07876ae99da0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1240 microversion: 2.1 time: 0.372618 Sep 09 04:43:36.045183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 284/569] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:35 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1240 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:36.129260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:36.137801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:36.139268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:36.140416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-44192db4-aa53-4a8f-b465-e00b1c24b038 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1599 microversion: 2.20 time: 0.216386 Sep 09 04:43:36.140982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 286/570] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:43:35 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:43:36.165010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:36.165582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:36.171584 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:36.172073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:36.172516 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:36.173216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:36.173672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:36.174098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:36.304381 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-94fd122e-8154-49ad-8496-9ef399e8592f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143152 Sep 09 04:43:36.305533 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 285/571] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Sep 9 04:43:36 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:43:36.691671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:36.692469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:36.699906 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:36.700481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:36.700927 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:36.701632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:36.702091 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:36.702555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:36.888616 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:36.895419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:36.912370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:36.912866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:36.913298 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:36.914362 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:36.919379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:36.920037 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:36.957836 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:36.968080 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-95f0c9a5-f183-44bc-9683-48b80f8aefe3 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.280603 Sep 09 04:43:36.969188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 287/572] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:36 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:36.982151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7b91e966-49cf-4053-9429-e55f7d41c82c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092840 Sep 09 04:43:36.982151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 286/573] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:43:36 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:37.067082 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:37.067694 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:37.075496 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:37.076198 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:37.076833 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:37.077699 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:37.078315 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:37.078897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:37.102433 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:37.184633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:37.194212 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6974bd37-acdd-4659-a846-e07fef8b2b43 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1292 microversion: 2.1 time: 0.131496 Sep 09 04:43:37.195172 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 288/574] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:37 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:37.589470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-88ecc1fa-d760-498b-b7c4-cce025ed338c req-83b16498-7789-424f-8849-f4b8f293fd52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88adb310-4be0-4b55-a3f9-65fe75a17959", "tag": "ffb258f4-dc03-4824-b22c-0f1742f0ed65"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:37.602548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-88ecc1fa-d760-498b-b7c4-cce025ed338c req-83b16498-7789-424f-8849-f4b8f293fd52 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:37.603442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-88ecc1fa-d760-498b-b7c4-cce025ed338c req-83b16498-7789-424f-8849-f4b8f293fd52 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:37.605063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-88ecc1fa-d760-498b-b7c4-cce025ed338c req-83b16498-7789-424f-8849-f4b8f293fd52 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:37.618344 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-88ecc1fa-d760-498b-b7c4-cce025ed338c req-83b16498-7789-424f-8849-f4b8f293fd52 service nova] Creating event network-changed:ffb258f4-dc03-4824-b22c-0f1742f0ed65 for instance 88adb310-4be0-4b55-a3f9-65fe75a17959 on hv-cinder-85600 Sep 09 04:43:37.624563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-88ecc1fa-d760-498b-b7c4-cce025ed338c req-83b16498-7789-424f-8849-f4b8f293fd52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040582 Sep 09 04:43:37.629290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 287/575] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:37.981838 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:37.984153 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:37.994153 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:37.995071 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:37.997006 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:37.997504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:37.997993 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:37.999295 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.000283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.001001 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.006149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.006645 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.011068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.012818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.013269 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.015086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.039053 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-585a41fe-e292-44f6-aa86-2d2db001b185 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061067 Sep 09 04:43:38.040057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 289/576] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:43:37 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 04:43:38.118396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:38.118895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:38.126334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.126859 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.127288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.128263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.128919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.129877 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.160723 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:43:38.220096 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:38.228338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6c6e71c2-09a6-4dd7-b9a6-e929d2245a42 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.238849 Sep 09 04:43:38.229673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 288/577] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:37 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:38.246276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:38.247114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:38.254330 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.254828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.255310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.256155 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.256736 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.257307 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.307420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-49325a0a-0d87-4247-8fd8-e0d8df32d848 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 204 len: 0 microversion: 2.1 time: 0.191099 Sep 09 04:43:38.308704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 290/578] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:43:38 2022] DELETE /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 04:43:38.331407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:38.332665 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:38.349796 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.351551 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.352101 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.353039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:38.353567 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:38.354780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:38.442233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:38.450474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0e9f3680-f4c4-4c16-85be-79e98f84e46e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1298 microversion: 2.1 time: 0.219982 Sep 09 04:43:38.451284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 289/579] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:38 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:38.618211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:38.630043 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c0215854-8f19-44d4-b9c8-5409873ad671 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1687 microversion: 2.1 time: 0.316009 Sep 09 04:43:38.630999 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 291/580] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:38 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1687 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:39.252987 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:39.253511 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:39.259952 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:39.260448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:39.260882 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:39.261565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:39.262012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:39.262863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:39.393796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:39.401325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-64f6bb61-166a-4b3e-a2c7-350256c7aacb tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.152295 Sep 09 04:43:39.401897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 290/581] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:39 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:39.455481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-3d819ef0-3aec-449d-816f-721d371f5895 req-e238f985-996b-4a6d-a735-3ed3ad9008be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51d5f24-f47e-4dd9-9948-81bfa8ed97dc", "name": "network-vif-plugged", "status": "completed", "tag": "a3fff027-2bdc-4c7e-a679-5b611770f4c2"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:39.465364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3d819ef0-3aec-449d-816f-721d371f5895 req-e238f985-996b-4a6d-a735-3ed3ad9008be service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:39.465873 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3d819ef0-3aec-449d-816f-721d371f5895 req-e238f985-996b-4a6d-a735-3ed3ad9008be service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:39.466275 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-3d819ef0-3aec-449d-816f-721d371f5895 req-e238f985-996b-4a6d-a735-3ed3ad9008be service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:39.473575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:39.474194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:39.478379 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-3d819ef0-3aec-449d-816f-721d371f5895 req-e238f985-996b-4a6d-a735-3ed3ad9008be service nova] Creating event network-vif-plugged:a3fff027-2bdc-4c7e-a679-5b611770f4c2 for instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc on hv-cinder-85600 Sep 09 04:43:39.480661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:39.481147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:39.481584 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:39.482486 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:39.482994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:39.483436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:39.483711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-3d819ef0-3aec-449d-816f-721d371f5895 req-e238f985-996b-4a6d-a735-3ed3ad9008be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Sep 09 04:43:39.484462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 292/582] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:39.611430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:39.619037 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5671279e-a6f7-403c-969e-233902ed6d5e tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.149287 Sep 09 04:43:39.620094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 291/583] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:39 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:39.654166 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:39.654870 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:39.660980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:39.661462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:39.661906 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:39.662730 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:39.663065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:39.663494 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:39.795149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:39.802801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1d50279d-106f-43be-85d2-676a81acac1e tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1687 microversion: 2.1 time: 0.152970 Sep 09 04:43:39.803399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 293/584] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:39 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:40.424857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:40.425491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:40.431987 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:40.432471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:40.432903 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:40.433595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:40.434041 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:40.434461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:40.559485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:40.567335 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b6d4616f-16ee-493e-ae31-1254fa60db9b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.146377 Sep 09 04:43:40.567895 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 292/585] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:40 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:40.641832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:40.642434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:40.649720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:40.650470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:40.651578 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:40.652268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:40.652714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:40.653137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:40.777731 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:40.785306 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b8676d5a-3aed-44fd-a250-76ed57d336b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.147274 Sep 09 04:43:40.785880 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 294/586] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:40 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:40.825998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:40.826536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:40.832364 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:40.832842 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:40.833275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:40.833958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:40.834403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:40.834820 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:40.962767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:40.971058 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c4808677-deef-4f71-84db-060b2cc874ae tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1687 microversion: 2.1 time: 0.149423 Sep 09 04:43:40.971626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 293/587] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:40 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:41.589741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:41.590346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:41.596613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:41.597100 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:41.597534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:41.598226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:41.599021 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:41.599149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:41.808016 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:41.808567 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:41.814864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:41.815781 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:41.816222 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:41.816927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:41.817420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:41.817848 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:41.879520 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:41.887211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7422edf0-f1b1-4e78-aeef-2e44f9f7fc39 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.301416 Sep 09 04:43:41.887784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 295/588] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:41 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:41.993781 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:41.994945 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:42.002560 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:42.003469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:42.004028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:42.005146 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:42.005723 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:42.006253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:42.048710 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:42.057793 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6f8378d5-3d65-469d-a505-29a431d7bc41 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.253813 Sep 09 04:43:42.064283 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 294/589] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:41 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:42.240225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:42.248591 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3c395f60-93cf-470d-80bc-c097e959e093 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1687 microversion: 2.1 time: 0.258841 Sep 09 04:43:42.249704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 296/590] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:41 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1687 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:42.463636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-40b0f911-76fd-49ed-9418-245bda237c40 req-e4266dae-7c1f-40f9-86b9-6fa850f26f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f332a8b8-4ec7-43ee-b027-ee59bbd0763a", "tag": "bd531f49-8a3c-4043-8dbe-1431619cc92e"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:42.473703 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-40b0f911-76fd-49ed-9418-245bda237c40 req-e4266dae-7c1f-40f9-86b9-6fa850f26f56 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:42.474471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-40b0f911-76fd-49ed-9418-245bda237c40 req-e4266dae-7c1f-40f9-86b9-6fa850f26f56 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:42.475032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-40b0f911-76fd-49ed-9418-245bda237c40 req-e4266dae-7c1f-40f9-86b9-6fa850f26f56 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:42.489098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-40b0f911-76fd-49ed-9418-245bda237c40 req-e4266dae-7c1f-40f9-86b9-6fa850f26f56 service nova] Creating event network-changed:bd531f49-8a3c-4043-8dbe-1431619cc92e for instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a on hv-cinder-85600 Sep 09 04:43:42.493984 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-40b0f911-76fd-49ed-9418-245bda237c40 req-e4266dae-7c1f-40f9-86b9-6fa850f26f56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035719 Sep 09 04:43:42.494726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 295/591] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:42.810291 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-cd2a1773-7400-4273-b2ad-a14f4b3b0389 req-fe4452e6-404f-4718-bd7d-0e6b232263cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b697ec-4fe5-4eb3-95c9-6890c141915b", "name": "network-vif-deleted", "tag": "e2bb2333-df06-4b43-a41b-37e81ef693cb"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:42.820107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cd2a1773-7400-4273-b2ad-a14f4b3b0389 req-fe4452e6-404f-4718-bd7d-0e6b232263cf service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:42.820716 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cd2a1773-7400-4273-b2ad-a14f4b3b0389 req-fe4452e6-404f-4718-bd7d-0e6b232263cf service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:42.821029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cd2a1773-7400-4273-b2ad-a14f4b3b0389 req-fe4452e6-404f-4718-bd7d-0e6b232263cf service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:42.833294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-cd2a1773-7400-4273-b2ad-a14f4b3b0389 req-fe4452e6-404f-4718-bd7d-0e6b232263cf service nova] Creating event network-vif-deleted:e2bb2333-df06-4b43-a41b-37e81ef693cb for instance 81b697ec-4fe5-4eb3-95c9-6890c141915b on hv-cinder-85600 Sep 09 04:43:42.838235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-cd2a1773-7400-4273-b2ad-a14f4b3b0389 req-fe4452e6-404f-4718-bd7d-0e6b232263cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Sep 09 04:43:42.839039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 297/592] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:42.912877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:42.914227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:42.925035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:42.925605 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:42.926108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:42.927088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:42.927557 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:42.927982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:43.082406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:43.083835 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:43.096827 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:43.099702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:43.100387 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:43.101322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:43.101790 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:43.102217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:43.121265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:43.130224 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ec788883-9c3d-4529-a057-4f87101c60e6 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1362 microversion: 2.1 time: 0.224137 Sep 09 04:43:43.131085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 296/593] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:42 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:43.268895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:43.271781 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:43.272567 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:43.277107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1b27c648-24c2-4315-92d5-443d8bd451a4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.199237 Sep 09 04:43:43.289263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 298/594] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:43 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:43.289435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:43.289435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:43.289435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:43.289435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:43.289815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:43.289815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:43.318700 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:43.319216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:43.319656 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:43.320098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lazy-loading 'fault' on Instance uuid 81b697ec-4fe5-4eb3-95c9-6890c141915b {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:43.361045 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:43.368925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0b4d244b-a3d5-474d-a746-81207a4b62ff tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 200 len: 1334 microversion: 2.1 time: 0.100894 Sep 09 04:43:43.369595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 297/595] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:43 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:44.153423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:44.154047 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:44.161069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.161558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.162000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.162704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.163187 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.163618 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.302121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:44.304357 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:44.312421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.313376 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.314624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.316098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.316737 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.316967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:44.317581 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.325750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8d92a4de-3c29-40a9-93ae-7745e9476ce4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1549 microversion: 2.1 time: 0.176199 Sep 09 04:43:44.326334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 299/596] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:44 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:44.348298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:44.348792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:44.356593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.357294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.357897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.358895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.359418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.360106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.472746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3760f871-c796-418e-b7e9-efd0c7a97a64 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128519 Sep 09 04:43:44.473409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 300/597] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:43:44 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:44.478006 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:44.479170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 81b697ec-4fe5-4eb3-95c9-6890c141915b] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:44.485330 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.485817 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.486253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.486983 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:44.487444 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:44.487869 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:44.500652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:44.503689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] HTTP exception thrown: Instance 81b697ec-4fe5-4eb3-95c9-6890c141915b could not be found. Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Request method failure captured: Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b HTTP/1.1 Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNm00-OuUMYpqLU-J1jDk2uHbHSIG7fwOGXAsJizzmC3IGtmdzcTkbUTGdBfwF-GNLFmqjzV-A2UZ7VM-Z2a63MqouKGWM-O5fUuh8a41_gduvl7Vjy57JW6yHtIoeX_3BtvBxjBtfT_Pjl5GxVSgPjQ2GfGF3bJAgmpGxvvWFkjHg Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:43:44.505338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}] Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: d3c29c23d7524adf9c5a3271224ac8d3 Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 81b697ec-4fe5-4eb3-95c9-6890c141915b could not be found. Sep 09 04:43:44.506669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '81b697ec-4fe5-4eb3-95c9-6890c141915b'} Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b697ec-4fe5-4eb3-95c9-6890c141915b could not be found. Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:44.507497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b697ec-4fe5-4eb3-95c9-6890c141915b could not be found. Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b697ec-4fe5-4eb3-95c9-6890c141915b could not be found. Sep 09 04:43:44.508924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:44.510288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Returning 404 to user: Instance 81b697ec-4fe5-4eb3-95c9-6890c141915b could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:44.510288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e3d8ec7e-fdc4-4691-83e3-2a4ee3fa6a9d tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b" status: 404 len: 111 microversion: 2.1 time: 0.032399 Sep 09 04:43:44.510288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 301/598] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:44 2022] GET /compute/v2.1/servers/81b697ec-4fe5-4eb3-95c9-6890c141915b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:43:44.512434 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c429431f-053b-44a9-810c-115c466ae8e0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.215580 Sep 09 04:43:44.513075 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 298/599] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:44 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:44.515513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-ec4cdf04-f130-4346-a86d-f927f4abd084 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '.version_select at 0x7f43fc23d820>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:44.529421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:44.538246 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-ec4cdf04-f130-4346-a86d-f927f4abd084 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689407732" status: 202 len: 0 microversion: 2.1 time: 0.026345 Sep 09 04:43:44.538821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 302/600] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 04:43:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689407732 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:43:45.470402 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-11b258fc-0bf1-4f1c-a925-bdee467f7004 req-dde5e0e9-aee7-48a7-933e-3cf7536b2f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51d5f24-f47e-4dd9-9948-81bfa8ed97dc", "tag": "a3fff027-2bdc-4c7e-a679-5b611770f4c2"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:45.480924 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-11b258fc-0bf1-4f1c-a925-bdee467f7004 req-dde5e0e9-aee7-48a7-933e-3cf7536b2f54 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:45.481443 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-11b258fc-0bf1-4f1c-a925-bdee467f7004 req-dde5e0e9-aee7-48a7-933e-3cf7536b2f54 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:45.481933 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-11b258fc-0bf1-4f1c-a925-bdee467f7004 req-dde5e0e9-aee7-48a7-933e-3cf7536b2f54 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:45.493034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-11b258fc-0bf1-4f1c-a925-bdee467f7004 req-dde5e0e9-aee7-48a7-933e-3cf7536b2f54 service nova] Creating event network-changed:a3fff027-2bdc-4c7e-a679-5b611770f4c2 for instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc on hv-cinder-85600 Sep 09 04:43:45.498617 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-11b258fc-0bf1-4f1c-a925-bdee467f7004 req-dde5e0e9-aee7-48a7-933e-3cf7536b2f54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031905 Sep 09 04:43:45.499382 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 299/601] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:45.534885 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:45.536234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:45.543028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=6 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:45.543684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=28 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:45.548346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:45.548838 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:45.549496 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:45.550211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:45.550664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:45.551117 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:45.697432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:45.707494 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7bbf3c95-4d0d-48b7-b59e-5cb738792dd8 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.176323 Sep 09 04:43:45.708163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 303/602] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:45 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:46.729038 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=8 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:46.733666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:46.734385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:46.740775 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:46.741257 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:46.741698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:46.742387 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:46.742842 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:46.743304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:46.872337 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:46.879930 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4ad9b638-9f3f-4f2d-abc1-c38ced22b24f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.152356 Sep 09 04:43:46.880492 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 300/603] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:46 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:47.446474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:47.447002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:47.453764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:47.454246 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:47.454682 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:47.455419 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:47.455872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:47.456501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:47.481587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:43:47.557436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-49bea969-dabe-4838-8ca3-52fa79401014 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 204 len: 0 microversion: 2.1 time: 0.114300 Sep 09 04:43:47.558570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 304/604] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:43:47 2022] DELETE /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:43:47.567077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:47.567684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:47.574042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:47.574521 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:47.574969 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:47.575661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:47.576108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:47.576528 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:47.711591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:47.715642 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:47.720669 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e44802ce-017b-4c09-a171-cbc5396ac6b9 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1507 microversion: 2.1 time: 0.157841 Sep 09 04:43:47.721233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 301/605] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:47 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:43:47.902174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:47.902876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:47.908758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:47.909271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:47.909670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:47.910369 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:47.910820 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:47.911273 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:47.915342 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:43:48.042268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:48.049798 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-da4cc73c-d214-4315-8223-186d1eb63388 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.151968 Sep 09 04:43:48.050365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 305/606] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:47 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:48.744050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:48.744579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:48.750924 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:48.751434 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:48.751866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:48.752553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:48.753000 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:48.753420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:48.880116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:48.888176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b6289555-5387-4fe8-bbe0-a634aa5546bb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1507 microversion: 2.1 time: 0.148289 Sep 09 04:43:48.888738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 302/607] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:48 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:49.073435 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:49.074046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:49.080428 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:49.080913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:49.081350 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:49.082036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:49.082491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:49.082912 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:49.210902 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:49.219044 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3d1f9f60-babd-4b62-9918-d4f730eb484a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.149886 Sep 09 04:43:49.219601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 306/608] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:49 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:49.479213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-534283c6-3045-4383-86a0-e08508e524ff req-ae491be5-9278-43b2-aee1-bee76a2c0861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f332a8b8-4ec7-43ee-b027-ee59bbd0763a", "name": "network-vif-plugged", "status": "completed", "tag": "bd531f49-8a3c-4043-8dbe-1431619cc92e"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:49.488839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-534283c6-3045-4383-86a0-e08508e524ff req-ae491be5-9278-43b2-aee1-bee76a2c0861 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:49.489313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-534283c6-3045-4383-86a0-e08508e524ff req-ae491be5-9278-43b2-aee1-bee76a2c0861 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:49.489749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-534283c6-3045-4383-86a0-e08508e524ff req-ae491be5-9278-43b2-aee1-bee76a2c0861 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:49.502085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-534283c6-3045-4383-86a0-e08508e524ff req-ae491be5-9278-43b2-aee1-bee76a2c0861 service nova] Creating event network-vif-plugged:bd531f49-8a3c-4043-8dbe-1431619cc92e for instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a on hv-cinder-85600 Sep 09 04:43:49.506970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-534283c6-3045-4383-86a0-e08508e524ff req-ae491be5-9278-43b2-aee1-bee76a2c0861 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Sep 09 04:43:49.507556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 303/609] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:49.911434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:49.912075 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:49.918384 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:49.918946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:49.919453 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:49.920142 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:49.920593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:49.921015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:50.048531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:50.056251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8551cbca-8ca7-4ea6-8bc3-7ad466457ba3 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1507 microversion: 2.1 time: 0.148704 Sep 09 04:43:50.056818 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 307/610] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:49 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:50.241766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:50.242418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:50.249021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:50.249499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:50.249933 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:50.250617 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:50.251103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:50.251526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:50.379589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:50.387657 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6ce9f791-ed39-431b-ace2-b63fcfc6f5f4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.150089 Sep 09 04:43:50.388235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 304/611] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:50 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:51.079754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:51.080376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:51.086805 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:51.087308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:51.087737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:51.088426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:51.088870 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:51.089290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:51.154676 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:51.162399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-281495f6-1c89-46d9-a82e-e2a4389577ca tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1465 microversion: 2.1 time: 0.086489 Sep 09 04:43:51.175126 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 308/612] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:51 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1465 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:51.234905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-dc113736-3f29-42f4-88ee-5d63a77fc59f req-650064ed-0427-43c8-a622-5f453c32819e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc64fdf-1f32-4a6f-9194-af9ea4628027", "name": "network-vif-deleted", "tag": "bc5dbac3-7cd6-4c6c-bd0e-b46429ecebfe"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:51.244970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-dc113736-3f29-42f4-88ee-5d63a77fc59f req-650064ed-0427-43c8-a622-5f453c32819e service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:51.245630 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-dc113736-3f29-42f4-88ee-5d63a77fc59f req-650064ed-0427-43c8-a622-5f453c32819e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:51.245864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-dc113736-3f29-42f4-88ee-5d63a77fc59f req-650064ed-0427-43c8-a622-5f453c32819e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:51.256738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-dc113736-3f29-42f4-88ee-5d63a77fc59f req-650064ed-0427-43c8-a622-5f453c32819e service nova] Creating event network-vif-deleted:bc5dbac3-7cd6-4c6c-bd0e-b46429ecebfe for instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 on hv-cinder-85600 Sep 09 04:43:51.261725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-dc113736-3f29-42f4-88ee-5d63a77fc59f req-650064ed-0427-43c8-a622-5f453c32819e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Sep 09 04:43:51.262316 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 305/613] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:51.410558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:51.411128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:51.417518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:51.418000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:51.418466 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:51.419191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:51.419644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:51.420067 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:51.555357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:51.563323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4736820e-8089-464f-ab11-1e6ed44932b9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1366 microversion: 2.1 time: 0.156615 Sep 09 04:43:51.564103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 309/614] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:51 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:52.188258 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:52.188889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:52.195230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:52.195708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:52.196142 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:52.196819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:52.197756 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:52.198175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:52.227924 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:52.228394 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:52.228825 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:52.229261 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lazy-loading 'fault' on Instance uuid 7bc64fdf-1f32-4a6f-9194-af9ea4628027 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:43:52.269548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:52.277888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8594c40f-ec74-4f3b-b562-68233e904e7b tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 200 len: 1312 microversion: 2.1 time: 0.093883 Sep 09 04:43:52.278469 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 306/615] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:52 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:52.585737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:52.586346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:52.592773 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:52.593252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:52.593687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:52.594376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:52.594827 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:52.595275 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:52.723269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:52.731376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c35bfe4a-03a2-4977-866f-1428332aef62 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1556 microversion: 2.1 time: 0.149461 Sep 09 04:43:52.731938 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 310/616] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:52 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:52.753614 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:52.754103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:52.760010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:52.760485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:52.760921 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:52.761602 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:52.762050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:52.762466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:52.836739 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-905652e1-50ef-4f10-804b-ae56673c9013 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086910 Sep 09 04:43:52.837363 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 307/617] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:43:52 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:53.299624 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:53.300293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 7bc64fdf-1f32-4a6f-9194-af9ea4628027] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:53.306839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:53.307354 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:53.307789 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:53.308485 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:53.308930 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:53.309348 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:53.329821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] HTTP exception thrown: Instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 could not be found. Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Request method failure captured: Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 HTTP/1.1 Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNm00-OuUMYpqLU-J1jDk2uHbHSIG7fwOGXAsJizzmC3IGtmdzcTkbUTGdBfwF-GNLFmqjzV-A2UZ7VM-Z2a63MqouKGWM-O5fUuh8a41_gduvl7Vjy57JW6yHtIoeX_3BtvBxjBtfT_Pjl5GxVSgPjQ2GfGF3bJAgmpGxvvWFkjHg Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:43:53.331565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}] Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: d3c29c23d7524adf9c5a3271224ac8d3 Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 could not be found. Sep 09 04:43:53.333033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '7bc64fdf-1f32-4a6f-9194-af9ea4628027'} Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 could not be found. Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:53.337150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 could not be found. Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 could not be found. Sep 09 04:43:53.340202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:53.341972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Returning 404 to user: Instance 7bc64fdf-1f32-4a6f-9194-af9ea4628027 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:53.341972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-aba823fd-4b7b-4e80-a791-6c2321252a0c tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027" status: 404 len: 111 microversion: 2.1 time: 0.037197 Sep 09 04:43:53.341972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 311/618] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:53 2022] GET /compute/v2.1/servers/7bc64fdf-1f32-4a6f-9194-af9ea4628027 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:43:53.348304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:53.348837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:53.355505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:53.356101 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:53.356625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:53.357434 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:53.357890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:53.358315 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:53.383509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:43:53.465619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a9ed087c-d1bd-4044-9fb0-1939d8d30738 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "DELETE /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 204 len: 0 microversion: 2.1 time: 0.121211 Sep 09 04:43:53.466397 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 308/619] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:43:53 2022] DELETE /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:43:53.475412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:53.476037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:53.482102 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:53.482575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:53.483084 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:53.483784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:53.484241 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:53.484670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:53.920348 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:53.928033 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cfea4de2-cca4-4ba5-a085-643a36171135 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.457344 Sep 09 04:43:53.928602 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 312/620] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:53 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:54.084251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-ed47cb3e-e891-41a1-9229-905ae81986ac req-c634ff84-3b9b-4956-8223-8344d81ee21c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f332a8b8-4ec7-43ee-b027-ee59bbd0763a", "tag": "bd531f49-8a3c-4043-8dbe-1431619cc92e"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:54.095226 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ed47cb3e-e891-41a1-9229-905ae81986ac req-c634ff84-3b9b-4956-8223-8344d81ee21c service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:54.095713 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ed47cb3e-e891-41a1-9229-905ae81986ac req-c634ff84-3b9b-4956-8223-8344d81ee21c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:54.096170 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ed47cb3e-e891-41a1-9229-905ae81986ac req-c634ff84-3b9b-4956-8223-8344d81ee21c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:54.107286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-ed47cb3e-e891-41a1-9229-905ae81986ac req-c634ff84-3b9b-4956-8223-8344d81ee21c service nova] Creating event network-changed:bd531f49-8a3c-4043-8dbe-1431619cc92e for instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a on hv-cinder-85600 Sep 09 04:43:54.112368 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-ed47cb3e-e891-41a1-9229-905ae81986ac req-c634ff84-3b9b-4956-8223-8344d81ee21c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032138 Sep 09 04:43:54.112966 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 309/621] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:54.952254 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:54.953010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:54.959661 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:54.960143 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:54.960575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:54.961276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:54.961733 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:54.962153 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:55.097212 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:55.104909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-65d26d0a-2872-49c1-9fde-326c3daff62f tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.156592 Sep 09 04:43:55.105480 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 313/622] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:54 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:56.128122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:56.128821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:56.136025 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:56.136510 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:56.136948 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:56.137647 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:56.138098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:56.138525 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:56.425043 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:56.433311 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7db42151-0ed9-47ea-bcad-c61b873f84cb tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1520 microversion: 2.1 time: 0.309387 Sep 09 04:43:56.433875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 310/623] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:56 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:57.456297 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:57.457050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:57.464196 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:57.464777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:57.465286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:57.466206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:57.466734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:57.467395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:57.609817 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c29c23d7524adf9c5a3271224ac8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d203c97242044fb8bf29bdc461e2efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:43:57.617458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8cc42f15-aea3-4d89-b615-eb8a77f95b32 tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 200 len: 1478 microversion: 2.1 time: 0.165048 Sep 09 04:43:57.618013 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 314/624] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:57 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 1478 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:43:57.662267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-ebae0269-be52-4554-862d-64d09424eafd req-358cd44f-33f0-4a8f-b8b5-54c8afa71512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b22e86-a3f6-4e3d-bb20-2ef261176f1f", "name": "network-vif-deleted", "tag": "a018459f-533b-4aed-aa62-2552577cedef"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:43:57.674049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ebae0269-be52-4554-862d-64d09424eafd req-358cd44f-33f0-4a8f-b8b5-54c8afa71512 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:57.674773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ebae0269-be52-4554-862d-64d09424eafd req-358cd44f-33f0-4a8f-b8b5-54c8afa71512 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:57.675231 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-ebae0269-be52-4554-862d-64d09424eafd req-358cd44f-33f0-4a8f-b8b5-54c8afa71512 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:57.694406 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-ebae0269-be52-4554-862d-64d09424eafd req-358cd44f-33f0-4a8f-b8b5-54c8afa71512 service nova] Creating event network-vif-deleted:a018459f-533b-4aed-aa62-2552577cedef for instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f on hv-cinder-85600 Sep 09 04:43:57.701238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-ebae0269-be52-4554-862d-64d09424eafd req-358cd44f-33f0-4a8f-b8b5-54c8afa71512 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043145 Sep 09 04:43:57.701840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 311/625] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:43:58.640425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:43:58.640957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] [instance: 86b22e86-a3f6-4e3d-bb20-2ef261176f1f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:43:58.647289 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:58.647775 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:58.648207 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:58.649116 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:43:58.649589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:43:58.650801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:43:58.664724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] HTTP exception thrown: Instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f could not be found. Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Request method failure captured: Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f HTTP/1.1 Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNm00-OuUMYpqLU-J1jDk2uHbHSIG7fwOGXAsJizzmC3IGtmdzcTkbUTGdBfwF-GNLFmqjzV-A2UZ7VM-Z2a63MqouKGWM-O5fUuh8a41_gduvl7Vjy57JW6yHtIoeX_3BtvBxjBtfT_Pjl5GxVSgPjQ2GfGF3bJAgmpGxvvWFkjHg Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:43:58.666216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1d203c97242044fb8bf29bdc461e2efd"}]}] Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 1d203c97242044fb8bf29bdc461e2efd Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1745003504 Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: d3c29c23d7524adf9c5a3271224ac8d3 Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1745003504-project Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f could not be found. Sep 09 04:43:58.667779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '86b22e86-a3f6-4e3d-bb20-2ef261176f1f'} Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f could not be found. Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:43:58.668749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f could not be found. Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f could not be found. Sep 09 04:43:58.670170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:43:58.671472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] Returning 404 to user: Instance 86b22e86-a3f6-4e3d-bb20-2ef261176f1f could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:43:58.671472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6c33754e-1fe2-4743-9552-6aa3326619ef tempest-ServerRescueNegativeTestJSON-1745003504 tempest-ServerRescueNegativeTestJSON-1745003504-project] 10.222.0.20 "GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f" status: 404 len: 111 microversion: 2.1 time: 0.031178 Sep 09 04:43:58.671472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 315/626] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:43:58 2022] GET /compute/v2.1/servers/86b22e86-a3f6-4e3d-bb20-2ef261176f1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:44:02.772556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4edfef91-94db-46e7-b8d2-bd84b11c352c tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Action: 'create', calling method: .version_select at 0x7f43faea48b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-677954933", "metadata": {"Type": "work"}}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:03.066905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4edfef91-94db-46e7-b8d2-bd84b11c352c tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.410048 Sep 09 04:44:03.067721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 312/627] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Sep 9 04:44:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 412 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 04:44:03.080029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7d58bb36-d666-4ac3-9c1a-c469eaca73c9 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Calling method '.version_select at 0x7f43fc23d820>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:03.131680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7d58bb36-d666-4ac3-9c1a-c469eaca73c9 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d" status: 200 len: 352 microversion: 2.1 time: 0.055248 Sep 09 04:44:03.132241 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 316/628] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:44:03 2022] GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:04.147129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0c4116ed-8281-4008-8122-c1d8106bd2cd tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Calling method '.version_select at 0x7f43fad18790>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:04.194797 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0c4116ed-8281-4008-8122-c1d8106bd2cd tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d" status: 200 len: 353 microversion: 2.1 time: 0.052047 Sep 09 04:44:04.195474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 313/629] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:44:04 2022] GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:04.209642 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4725aeb7-83f5-4078-bba9-300b9cca1b87 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Calling method '.version_select at 0x7f43fac8d550>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:04.256003 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4725aeb7-83f5-4078-bba9-300b9cca1b87 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d" status: 200 len: 353 microversion: 2.1 time: 0.050658 Sep 09 04:44:04.256588 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 317/630] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:44:04 2022] GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:04.274366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d6f9d852-2909-4506-894a-63887c7e3e62 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Calling method '.version_select at 0x7f43facb2550>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:04.332916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d6f9d852-2909-4506-894a-63887c7e3e62 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d" status: 202 len: 0 microversion: 2.1 time: 0.062272 Sep 09 04:44:04.333496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 314/631] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:44:04 2022] DELETE /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:44:04.341891 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e1553c79-bfad-4a0a-b52b-c1d42b397582 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Calling method '.version_select at 0x7f43fac42790>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:04.391437 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e1553c79-bfad-4a0a-b52b-c1d42b397582 tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d" status: 200 len: 352 microversion: 2.1 time: 0.053716 Sep 09 04:44:04.392006 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 318/632] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:44:04 2022] GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:05.406808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5b41c5d3-8145-4400-bb7c-f89f87b10f4e tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Calling method '.version_select at 0x7f43fad8ec10>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:05.435563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-5b41c5d3-8145-4400-bb7c-f89f87b10f4e tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] HTTP exception thrown: Volume c7cc8254-d798-442d-961c-300250bd619d could not be found. Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5b41c5d3-8145-4400-bb7c-f89f87b10f4e tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Request method failure captured: Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d HTTP/1.1 Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsSSltqdNxD5nZhQsWvBCGeN54jMxbTFIKnPOWgOBfGsO14lsLIgvY1BCvdxzYXyxXOxlI2bNcLouUIPr2Dbd37hu4XKOFXwQ8JYBK8stSWL8RulMT4XFgMLAdSPD7EPNI_N2KoknxW-nJKDR5xZkxqyyHELCfBn1NLJQJCnyDmvbAA Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: b3b2f87c566844beb02d98fa01082bfe Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesGetTestJSON-2121698835 Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:44:05.437608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3b2f87c566844beb02d98fa01082bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3b2f87c566844beb02d98fa01082bfe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3b2f87c566844beb02d98fa01082bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3b2f87c566844beb02d98fa01082bfe"}]}] Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesGetTestJSON-2121698835 Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: b3b2f87c566844beb02d98fa01082bfe Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesGetTestJSON-2121698835 Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesGetTestJSON-2121698835-project Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: a7908f2dc30a4961a4b50a40f5c706d0 Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesGetTestJSON-2121698835-project Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Volume c7cc8254-d798-442d-961c-300250bd619d could not be found. Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'c7cc8254-d798-442d-961c-300250bd619d'} Sep 09 04:44:05.439121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7cc8254-d798-442d-961c-300250bd619d could not be found. (HTTP 404) (Request-ID: req-50ef6351-d66d-4b6a-8ce5-76a39625aa3c) Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:44:05.440080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:44:05.441684 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7cc8254-d798-442d-961c-300250bd619d could not be found. Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 04:44:05.443317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7cc8254-d798-442d-961c-300250bd619d could not be found. Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7cc8254-d798-442d-961c-300250bd619d could not be found. Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5b41c5d3-8145-4400-bb7c-f89f87b10f4e tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] Returning 404 to user: Volume c7cc8254-d798-442d-961c-300250bd619d could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5b41c5d3-8145-4400-bb7c-f89f87b10f4e tempest-VolumesGetTestJSON-2121698835 tempest-VolumesGetTestJSON-2121698835-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d" status: 404 len: 109 microversion: 2.1 time: 0.036587 Sep 09 04:44:05.444674 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 315/633] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:44:05 2022] GET /compute/v2.1/os-volumes/c7cc8254-d798-442d-961c-300250bd619d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:44:13.836219 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:13.836971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=56 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:14.003122 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:14.003618 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:14.009675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:14.010007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:14.011005 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:14.011706 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:14.012163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:14.012592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:14.037355 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8c42de0e-810f-4168-95cb-7ab614914f5f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/ips" status: 200 len: 151 microversion: 2.20 time: 0.202591 Sep 09 04:44:14.037914 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 319/634] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Sep 9 04:44:13 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/ips => generated 151 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:44:16.500340 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:16.501105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:16.505620 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:16.506284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:16.515559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:16.515947 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:16.516389 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:16.517091 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:16.517550 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:16.517980 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:16.541882 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lazy-loading 'flavor' on Instance uuid 88adb310-4be0-4b55-a3f9-65fe75a17959 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:44:16.731073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0da3245b-d375-4940-aa4c-4cb08b0f64bc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/action" status: 202 len: 0 microversion: 2.20 time: 0.231895 Sep 09 04:44:16.734982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 316/635] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 04:44:16 2022] POST /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:44:16.740639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:16.741322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:16.750004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:16.750567 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:16.751113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:16.751876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:16.752531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:16.753300 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:16.889410 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:16.898893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:16.900334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:16.901267 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b6af5d6d-14e8-4530-b680-3552c25c1925 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.164490 Sep 09 04:44:16.901822 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 320/636] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:16 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:17.928135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:17.928828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:17.936329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:17.936808 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:17.937251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:17.937940 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:17.938393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:17.938830 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:18.066580 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:18.075189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:18.076648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:18.077802 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-aea6fb73-085a-4ab7-9616-1295bb006e97 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.154508 Sep 09 04:44:18.078350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 317/637] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:17 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:19.103355 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:19.104029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:19.110438 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:19.110919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:19.111385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:19.112106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:19.112559 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:19.112988 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:19.238156 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:19.246758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:19.248248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:19.249407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-10ecf0cc-5deb-484f-be34-27b33a8ed5f4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.149958 Sep 09 04:44:19.249962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 321/638] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:19 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:20.274632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:20.275272 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:20.282070 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:20.282551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:20.283021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:20.283712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:20.284167 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:20.284591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:20.414275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:20.422311 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:20.423794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:20.424956 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-86a47b34-d053-4e3e-aac7-a677f3dd1c0e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.154283 Sep 09 04:44:20.425513 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 318/639] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:20 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:21.450388 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:21.451007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:21.457539 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:21.458035 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:21.458478 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:21.459198 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:21.459652 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:21.460073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:21.585828 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:21.596531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:21.598274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:21.599668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2c7f98e2-7bfe-47fd-aac3-1df0a9f5e07f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.153164 Sep 09 04:44:21.615848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 322/640] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:21 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:21.696913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:21.697435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:21.704314 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:21.705372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:21.706065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:21.706956 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:21.707417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:21.708031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:21.734662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e94a302b-cc80-4007-b291-4dbccb1e88ce tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/ips" status: 200 len: 147 microversion: 2.1 time: 0.160631 Sep 09 04:44:21.742394 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 319/641] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:44:21 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/ips => generated 147 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:44:22.629001 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:22.629586 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:22.635799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:22.636279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:22.636713 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:22.637399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:22.637856 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:22.638277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:22.768128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:22.776174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:22.777616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:22.778761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a660d965-de18-49c0-b8a8-5ad472563e22 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.153749 Sep 09 04:44:22.779339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 323/642] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:22 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:23.230865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cc203f9-323f-450d-815a-1396ae58861e"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:23.233425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:23.240405 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:23.240882 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:23.241316 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:23.242007 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:23.242457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:23.242877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:23.528251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-154bc9c6-3779-475f-ad1f-561120edbd93 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301749 Sep 09 04:44:23.528796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 320/643] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:44:23 2022] POST /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:23.804283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:23.804993 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:23.811833 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:23.812312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:23.812766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:23.813453 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:23.814002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:23.814466 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:23.939270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:23.947402 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:23.949460 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:23.950597 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d572780f-e41c-488a-b0b7-39d614c66954 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.150211 Sep 09 04:44:23.951188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 324/644] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:23 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:24.976967 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:24.977687 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:24.984068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:24.987310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:24.987310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:24.987310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:24.987310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:24.987687 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:25.125491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:25.134263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:25.135743 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:25.137504 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f49ffedc-b4c6-422d-943d-ea0b869bb61f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.165409 Sep 09 04:44:25.138064 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 321/645] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:24 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:26.163759 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:26.164365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:26.171689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:26.172177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:26.172818 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:26.173700 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:26.174158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:26.174588 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:26.321248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:26.330867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:26.332563 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:26.333784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b974ebd7-f432-457a-91e9-126f8e52199b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.173841 Sep 09 04:44:26.337043 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 325/646] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:26 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:27.360953 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:27.361574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:27.368322 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:27.368809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:27.369248 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:27.369946 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:27.370393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:27.371755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:27.502907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:27.512984 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:27.514457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:27.515666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6c4f36a8-b5f1-4f1b-9cff-59dc7c9db4fd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1745 microversion: 2.20 time: 0.158612 Sep 09 04:44:27.516421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 322/647] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:27 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:28.545675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:28.546229 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:28.552643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:28.553126 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:28.553562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:28.554252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:28.554704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:28.555172 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:28.681697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:28.689686 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:28.691429 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:28.692621 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-67f4c262-014f-4b60-bfa0-38c415f16ae5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1745 microversion: 2.20 time: 0.151531 Sep 09 04:44:28.693181 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 326/648] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:28 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:29.718611 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:29.719266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:29.723481 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 04:44:29.723633 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Fri Sep 9 04:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 (ip 10.222.0.20) !!! Sep 09 04:44:29.735109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:29.735600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:29.736035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:29.736742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:29.737196 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:29.737621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:29.868779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:29.876857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:29.878310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:29.879507 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-07eb418e-8bae-4c75-b7fe-7b865fd36936 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.165730 Sep 09 04:44:29.880065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 323/649] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:29 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:30.911681 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:30.912977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:30.926424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:30.927192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:30.927925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:30.928643 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:30.929411 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:30.930135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:31.112345 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:31.115750 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:31.123383 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:31.124143 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:31.124631 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:31.124772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:31.125336 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:31.125788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:31.126202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:31.135214 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:31.136673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:31.138615 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-064dbbe0-e722-483f-bf87-c99722d2c62f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.232671 Sep 09 04:44:31.139385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 327/650] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:30 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:31.175014 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f9796a8d-8278-42b0-a434-795cae941aea tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068841 Sep 09 04:44:31.175886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 324/651] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:31 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:31.194769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:31.196431 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:31.205850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:31.206353 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:31.206792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:31.207525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:31.208160 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:31.208746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:31.243310 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-59521acd-f8b0-4402-9d94-ba539675044d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/7cc203f9-323f-450d-815a-1396ae58861e" status: 200 len: 194 microversion: 2.1 time: 0.059911 Sep 09 04:44:31.244573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 328/652] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Sep 9 04:44:31 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/7cc203f9-323f-450d-815a-1396ae58861e => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:31.837372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-54fbdcf4-416b-436a-9954-23e8f755b8f1 req-0031c998-2a67-4e0b-843e-819312b4467b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88adb310-4be0-4b55-a3f9-65fe75a17959", "name": "network-vif-plugged", "status": "completed", "tag": "ffb258f4-dc03-4824-b22c-0f1742f0ed65"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:31.850163 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-54fbdcf4-416b-436a-9954-23e8f755b8f1 req-0031c998-2a67-4e0b-843e-819312b4467b service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:31.851013 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-54fbdcf4-416b-436a-9954-23e8f755b8f1 req-0031c998-2a67-4e0b-843e-819312b4467b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:31.851722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-54fbdcf4-416b-436a-9954-23e8f755b8f1 req-0031c998-2a67-4e0b-843e-819312b4467b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:31.864875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-54fbdcf4-416b-436a-9954-23e8f755b8f1 req-0031c998-2a67-4e0b-843e-819312b4467b service nova] Creating event network-vif-plugged:ffb258f4-dc03-4824-b22c-0f1742f0ed65 for instance 88adb310-4be0-4b55-a3f9-65fe75a17959 on hv-cinder-85600 Sep 09 04:44:31.870899 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-54fbdcf4-416b-436a-9954-23e8f755b8f1 req-0031c998-2a67-4e0b-843e-819312b4467b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037759 Sep 09 04:44:31.872754 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 325/653] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:44:32.061158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:32.061812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:32.072141 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:32.072633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:32.076442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:32.077529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:32.080062 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:32.080817 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:32.117540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-083a6a78-788c-4a38-a7cb-5305ddcd8f74 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/ips" status: 200 len: 150 microversion: 2.1 time: 0.061384 Sep 09 04:44:32.138660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 329/654] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:44:32 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:32.169529 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:32.170114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:32.182109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:32.182621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:32.183194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:32.184544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:32.184544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:32.185191 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:32.373823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:32.383820 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:32.385496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:32.388969 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-365c3180-b595-4a50-8503-ec556a023d68 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.225322 Sep 09 04:44:32.390084 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 326/655] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:32 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:32.707074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7a79a98-4a5a-458a-9ec7-508c681c7be0"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:32.710144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:32.719942 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:32.720427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:32.720861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:32.721784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:32.722463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:32.723128 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:33.088052 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7b770100-7eff-4a75-a3a1-a66ad942527e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "POST /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384712 Sep 09 04:44:33.089467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 330/656] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:44:32 2022] POST /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:33.417660 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:33.418265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:33.426663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:33.427183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:33.427787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:33.428640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:33.429247 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:33.429861 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:33.598156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:33.618300 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:33.619758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:33.631468 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-88fa4af1-8390-4b66-9a12-f1d2f389852c tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.207118 Sep 09 04:44:33.631468 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 327/657] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:33 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:33.642320 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c4fd949-c409-4fb4-a055-683452c572c3"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:33.646391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:33.655759 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:33.656517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:33.656945 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:33.657969 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:33.658582 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:33.659037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:34.069293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-09e957cc-a459-4bd0-9a0a-8fbded368cc6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432134 Sep 09 04:44:34.069922 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 331/658] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:44:33 2022] POST /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:34.648438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:34.649039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:34.656424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:34.658144 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:34.659126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:34.660485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:34.661101 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:34.661742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:34.843323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:34.853989 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:34.856431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:34.857793 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-11a256e5-e6ee-40fe-b85e-7e431df10f79 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.213310 Sep 09 04:44:34.858350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 328/659] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:34 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:35.887491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:35.888850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:35.896585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:35.897542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:35.898513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:35.899459 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:35.900114 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:35.900742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:36.061157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:36.079980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:36.081430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:36.082589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6d762554-1503-46bd-a0e0-417faf8d6f5a tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.202863 Sep 09 04:44:36.083360 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 332/660] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:35 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:37.109326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:37.109935 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:37.116928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:37.117507 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:37.118036 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:37.118810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:37.119356 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:37.120047 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:37.264741 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:37.273152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:37.275913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:37.277740 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ac8bfa24-4965-454f-8e3e-226ac43723dc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.172438 Sep 09 04:44:37.278785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 329/661] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:37 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:38.307191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:38.308469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:38.315145 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:38.316081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:38.317209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:38.318070 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:38.318695 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:38.319137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:38.348758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:38.509165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:38.522421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:38.524555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:38.526139 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-aa1d20c6-206e-4cbc-a2a3-89aac742faee tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.226455 Sep 09 04:44:38.535982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 333/662] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:38 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:39.564518 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:39.566305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:39.574370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:39.575162 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:39.575950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:39.576992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:39.577753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:39.578353 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:39.585049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:39.775145 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:39.788555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:39.790274 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:39.793246 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-18248aff-c8c4-4483-959a-c260568489a8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.234984 Sep 09 04:44:39.811780 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 330/663] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:39 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:40.821739 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:40.822961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:40.831848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:40.832144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:40.832574 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:40.833542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:40.834877 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:40.835474 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:40.909071 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:40.911500 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:40.917658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:40.918147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:40.919164 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:40.920020 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:40.920474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:40.921407 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:40.958123 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-34379513-ca48-4289-bb00-5b12b680136c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053566 Sep 09 04:44:40.959187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 331/664] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:40 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:40.988427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:40.996394 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:40.997880 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:40.999052 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cc327b71-71fc-415e-95a4-7a2298372249 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1740 microversion: 2.20 time: 0.181170 Sep 09 04:44:40.999616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 334/665] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:40 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:41.102095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:41.102825 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:41.109565 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:41.110131 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:41.110895 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:41.111885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:41.112483 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:41.113032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:41.145553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3e186c39-8a00-4a56-a924-173ab959aea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/7cc203f9-323f-450d-815a-1396ae58861e" status: 200 len: 194 microversion: 2.1 time: 0.047830 Sep 09 04:44:41.146266 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 332/666] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Sep 9 04:44:41 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/7cc203f9-323f-450d-815a-1396ae58861e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:41.157282 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:41.157842 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:41.163974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:41.164657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:41.165358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:41.166271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:41.167065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:41.167510 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:41.260593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lazy-loading 'services' on Instance uuid d51d5f24-f47e-4dd9-9948-81bfa8ed97dc {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:44:41.336166 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-660ed7c2-d47a-4adf-bf6b-bb9e5fcf6d1f tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/7cc203f9-323f-450d-815a-1396ae58861e" status: 202 len: 0 microversion: 2.1 time: 0.183176 Sep 09 04:44:41.336674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 335/667] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:44:41 2022] DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/7cc203f9-323f-450d-815a-1396ae58861e => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:44:42.024436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:42.025078 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:42.031430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:42.031915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:42.032353 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:42.033042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:42.033499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:42.033925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:42.256197 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:42.266894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:42.268378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:42.269593 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-349bf72c-ddbc-47b2-bce8-9863126c1a17 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1722 microversion: 2.20 time: 0.249144 Sep 09 04:44:42.273779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 333/668] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:42 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:43.296051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:43.296817 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:43.303275 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:43.303762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:43.304191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:43.304876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:43.305320 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:43.305737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:43.447621 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:43.456602 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:43.458030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:43.459215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f8b24bf1-1c17-4eb3-b7c3-84930555636e tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1722 microversion: 2.20 time: 0.168192 Sep 09 04:44:43.459777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 336/669] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:43 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:44.486913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:44.487766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:44.494219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:44.494695 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:44.495175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:44.495869 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:44.496324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:44.496752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:44.626222 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:44.634242 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:44.635725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:44.636887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e1b3007b-e250-469b-ad49-c7c704517fcc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1725 microversion: 2.20 time: 0.153889 Sep 09 04:44:44.638100 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 334/670] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:44 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:44.662814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "509e3540-6fe0-46d5-96a9-1bc8454e4858"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:44.665268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:44.667831 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=37 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:44.672966 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:44.673442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:44.673875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:44.674559 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:44.675031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:44.675454 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:44.959661 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e0c62b0f-6b0f-410d-b825-d4728499f2b5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300837 Sep 09 04:44:44.960264 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 337/671] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Sep 9 04:44:44 2022] POST /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 04:44:45.090434 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:45.090946 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:45.096799 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:45.097285 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:45.097723 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:45.098417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:45.098870 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:45.099325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:45.401069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b2ba9b68-f192-44dd-bbb9-8bff24c0a497 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-volume_attachments/509e3540-6fe0-46d5-96a9-1bc8454e4858" status: 202 len: 0 microversion: 2.20 time: 0.314277 Sep 09 04:44:45.401672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 335/672] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Sep 9 04:44:45 2022] DELETE /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-volume_attachments/509e3540-6fe0-46d5-96a9-1bc8454e4858 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:44:45.477786 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:45.478408 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:45.484934 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:45.485420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:45.485864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:45.486554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:45.487036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:45.487461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:45.516069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127436) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 04:44:45.580833 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-50675f9f-9c20-4579-a6f5-0a88042bcfb4 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "POST /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/action" status: 202 len: 0 microversion: 2.20 time: 0.106876 Sep 09 04:44:45.581749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 338/673] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Sep 9 04:44:45 2022] POST /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:44:45.596022 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:45.597522 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:45.606956 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:45.607568 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:45.608730 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:45.609500 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:45.610058 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:45.610735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:45.754086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:45.762505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:45.764494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:45.766147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-35556aaf-71ab-4ecd-9ce7-5b62e194714b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1673 microversion: 2.20 time: 0.180053 Sep 09 04:44:45.767383 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 336/674] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:45 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:45.935923 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-694cf92b-d137-4916-8f01-b25bc931b8e3 req-f7158455-c87b-4fa8-96b7-23f61cfc73f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88adb310-4be0-4b55-a3f9-65fe75a17959", "name": "network-vif-unplugged", "status": "completed", "tag": "ffb258f4-dc03-4824-b22c-0f1742f0ed65"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:45.945648 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-694cf92b-d137-4916-8f01-b25bc931b8e3 req-f7158455-c87b-4fa8-96b7-23f61cfc73f9 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:45.946122 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-694cf92b-d137-4916-8f01-b25bc931b8e3 req-f7158455-c87b-4fa8-96b7-23f61cfc73f9 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:45.946687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-694cf92b-d137-4916-8f01-b25bc931b8e3 req-f7158455-c87b-4fa8-96b7-23f61cfc73f9 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:45.960675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.compute.server_external_events [req-694cf92b-d137-4916-8f01-b25bc931b8e3 req-f7158455-c87b-4fa8-96b7-23f61cfc73f9 service nova] Unable to find a host for instance 88adb310-4be0-4b55-a3f9-65fe75a17959. Dropping event network-vif-unplugged {{(pid=127436) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 04:44:45.961639 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-694cf92b-d137-4916-8f01-b25bc931b8e3 req-f7158455-c87b-4fa8-96b7-23f61cfc73f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.191769 Sep 09 04:44:45.962481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 339/675] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 193 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 09 04:44:46.792597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:46.793237 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:46.796065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=43 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:46.801338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:46.801819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:46.802253 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:46.802956 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:46.803411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:46.803832 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:46.936840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:46.950670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:46.952608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:46.954157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ffea6985-d9d8-489f-84f9-0118743ffb9f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1673 microversion: 2.20 time: 0.165419 Sep 09 04:44:46.954885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 337/676] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:46 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:47.980810 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:47.981417 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:47.987909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:47.988392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:47.988832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:47.989528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:47.989987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:47.990413 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.107004 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c4fd949-c409-4fb4-a055-683452c572c3"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:44:48.110496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:48.116990 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.117476 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.117919 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.118663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.119295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.119724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.125821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:48.134489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:48.136090 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:48.137282 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7cc2f7ad-4d23-423e-9710-d0177e10c631 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.160473 Sep 09 04:44:48.137834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 340/677] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:47 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:48.206391 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Invalid volume: volume 8c4fd949-c409-4fb4-a055-683452c572c3 is already attached to instances: f332a8b8-4ec7-43ee-b027-ee59bbd0763a Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: POST /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments HTTP/1.1 Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 74 Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:44:48.208846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {"volumeAttachment": {"volumeId": "8c4fd949-c409-4fb4-a055-683452c572c3"}} Sep 09 04:44:48.210438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Invalid volume: volume 8c4fd949-c409-4fb4-a055-683452c572c3 is already attached to instances: f332a8b8-4ec7-43ee-b027-ee59bbd0763a Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'server_id': 'f332a8b8-4ec7-43ee-b027-ee59bbd0763a', 'body': {'volumeAttachment': {'volumeId': '8c4fd949-c409-4fb4-a055-683452c572c3'}}} Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8c4fd949-c409-4fb4-a055-683452c572c3 is already attached to instances: f332a8b8-4ec7-43ee-b027-ee59bbd0763a Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:48.211419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8c4fd949-c409-4fb4-a055-683452c572c3 is already attached to instances: f332a8b8-4ec7-43ee-b027-ee59bbd0763a Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:44:48.214019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8c4fd949-c409-4fb4-a055-683452c572c3 is already attached to instances: f332a8b8-4ec7-43ee-b027-ee59bbd0763a Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 400 to user: Invalid volume: volume 8c4fd949-c409-4fb4-a055-683452c572c3 is already attached to instances: f332a8b8-4ec7-43ee-b027-ee59bbd0763a {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-09a25a6e-b8d9-4333-9dd7-258717a84d27 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108590 Sep 09 04:44:48.216479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 338/678] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:44:48 2022] POST /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 04:44:48.292517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:48.293114 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:48.300216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.301067 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.301988 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.302991 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.303517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.304049 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.391997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'services' on Instance uuid f332a8b8-4ec7-43ee-b027-ee59bbd0763a {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:44:48.467609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7cb815b3-b007-4cd7-83e3-f603034b296d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments/8c4fd949-c409-4fb4-a055-683452c572c3" status: 202 len: 0 microversion: 2.1 time: 0.179128 Sep 09 04:44:48.468339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 341/679] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:44:48 2022] DELETE /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments/8c4fd949-c409-4fb4-a055-683452c572c3 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:44:48.477044 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:48.480286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:48.487460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.488196 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.488659 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.489447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.490170 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.490475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.525277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a9380e55-1ad2-46ff-92d2-704f2223d9f3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052323 Sep 09 04:44:48.525863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 339/680] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:48 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:48.839833 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:48.840978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:48.847069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.847554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.847992 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.848681 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.849137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.849561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.877363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0a756a89-8bbf-4a1e-90a5-9c3a32662ea5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/d7a79a98-4a5a-458a-9ec7-508c681c7be0" status: 200 len: 194 microversion: 2.1 time: 0.041823 Sep 09 04:44:48.877931 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 342/681] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Sep 9 04:44:48 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/d7a79a98-4a5a-458a-9ec7-508c681c7be0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:48.889864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:48.890321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:48.896236 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.896712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.897156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.897843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:48.898288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:48.898708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:48.994506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lazy-loading 'services' on Instance uuid d51d5f24-f47e-4dd9-9948-81bfa8ed97dc {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:44:49.114837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5171f785-fff3-45f9-862d-2bacae9e73c8 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/d7a79a98-4a5a-458a-9ec7-508c681c7be0" status: 202 len: 0 microversion: 2.1 time: 0.230153 Sep 09 04:44:49.115543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 340/682] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:44:48 2022] DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments/d7a79a98-4a5a-458a-9ec7-508c681c7be0 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:44:49.163426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:49.164357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:49.171302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:49.171784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:49.172670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:49.173379 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:49.173828 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:49.174250 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:49.313030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:49.322269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:49.323736 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:49.325439 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c6184030-d500-47a2-8f4f-94956967f020 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.165716 Sep 09 04:44:49.326155 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 343/683] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:49 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:49.538447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:49.540865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:49.547625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:49.548102 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:49.548537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:49.549223 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:49.549673 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:49.550093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:49.580108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a203e938-58f8-4556-a111-54788d2f4964 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046069 Sep 09 04:44:49.580654 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 341/684] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:49 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:50.336823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:50.339093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:50.346494 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.347032 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.347670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.348605 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.349055 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.349501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.352113 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:50.353622 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:50.359861 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.360682 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.361352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.362273 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.363184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.363971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.412615 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6a226a3a-f7b8-4bbc-b752-03035eaa6258 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079530 Sep 09 04:44:50.414079 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 344/685] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:50 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:50.522764 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:50.531890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:50.533769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:50.535295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f40a9d33-2c59-4523-b647-5c6c5ae171f8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.188107 Sep 09 04:44:50.536482 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 342/686] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:50 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:44:50.592163 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:50.594500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:50.600688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.601462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.601973 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.602750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.603482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.603977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.637227 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=6,nova_cell1:UPDATE=5 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:50.644312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-646cac96-e8dc-4760-aa1f-006d407b16fd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056073 Sep 09 04:44:50.647959 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 345/687] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:50 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 04:44:50.737129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:50.737629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:50.744725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.745496 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.745959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.746895 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.747398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.747830 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.775967 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:44:50.778457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:44:50.868017 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c41eb555-b83f-41b7-882a-c199846967b6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 204 len: 0 microversion: 2.1 time: 0.134412 Sep 09 04:44:50.869200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 343/688] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:44:50 2022] DELETE /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:44:50.880501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:50.881405 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:50.889039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.889785 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.890226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:50.890962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:50.891425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:50.891856 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:51.041002 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:51.049101 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e3e83826-a2ed-447e-ba4f-aa6db953e0e2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.174596 Sep 09 04:44:51.049676 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 346/689] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:50 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:51.426157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:51.428469 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:51.434983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:51.435471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:51.435899 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:51.436587 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:51.437033 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:51.437461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:51.478011 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c071ce32-4542-45e9-bfaa-925cb8675cc7 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055981 Sep 09 04:44:51.479370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 344/690] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:51 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:51.561966 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:51.562622 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:51.569793 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:51.570272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:51.570886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:51.571782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:51.572536 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:51.573111 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:51.713918 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:51.724050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:51.725766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:51.727203 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-21551d63-29a8-44a1-b085-97b400c275d6 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.169377 Sep 09 04:44:51.727779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 347/691] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:51 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:44:52.072497 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:52.073115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:52.079727 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:52.080219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:52.082495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:52.083339 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:52.083818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:52.084281 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:52.242406 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:52.251206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9278e17e-e71b-4c19-a669-f91dd51043a7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.182471 Sep 09 04:44:52.252057 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 345/692] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:52 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:52.492339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:52.494858 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:52.502316 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:52.502799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:52.503401 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:52.504106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:52.504555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:52.504974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:52.540665 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e58eb30b-1bb9-4429-ad93-d7aef24b0db2 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052737 Sep 09 04:44:52.541434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 348/693] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:52 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:52.759413 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:52.761099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:52.769886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:52.770535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:52.771193 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:52.772128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:52.772732 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:52.773331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:52.931786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:52.940694 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:52.942662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:52.944015 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5cba8be7-fa03-416f-b750-239a5277fabd tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.189810 Sep 09 04:44:52.944580 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 346/694] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:52 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:44:53.275325 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:53.275930 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:53.283504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:53.284260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:53.284852 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:53.285724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:53.286342 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:53.286766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:53.433287 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:53.441865 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-505727e8-12ab-48ce-81f2-a2c042091e2d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.170372 Sep 09 04:44:53.442792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 349/695] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:53 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:53.553653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:53.555912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:53.561979 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:53.562475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:53.562943 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:53.563636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:53.564115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:53.564598 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:53.597132 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2253e8f5-45fa-4267-a45d-ab5f398bad2b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047292 Sep 09 04:44:53.601693 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 347/696] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:53 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:53.974471 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:53.974707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:53.981097 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:53.981596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:53.982330 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:53.983061 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:53.983513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:53.983932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:54.125303 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:54.133867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:54.135734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:54.136941 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e17fc5ab-4b32-4249-9edb-f4e1307634df tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.167120 Sep 09 04:44:54.137505 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 350/697] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:53 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 04:44:54.466913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:54.467622 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:54.474392 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:54.474886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:54.475350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:54.476461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:54.476916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:54.477351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:54.610329 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:54.612916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:54.618088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:54.619802 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:54.620476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:54.620924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:54.622206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:54.622747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:54.623220 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:54.627004 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7ce08da9-0237-48ad-9153-9fddbae3092a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.164286 Sep 09 04:44:54.628696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 348/698] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:54 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:54.660869 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f02b26de-5d70-4204-b07c-7d851d068e4d tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054663 Sep 09 04:44:54.662059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 351/699] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:54 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:44:55.162065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:55.163124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:55.170181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:55.170748 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:55.171288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:55.172056 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:55.172582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:55.173077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:55.311233 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:55.321624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:55.323578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:55.326411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ae8a795b-5b57-4965-b29b-4990b93b1bb5 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.167920 Sep 09 04:44:55.327073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 349/700] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:55 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:55.653708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:55.654502 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:55.663102 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:55.663696 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:55.664244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:55.665135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:55.665784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:55.666252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:55.675110 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:55.677384 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:55.697884 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:55.698378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:55.698813 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:55.699613 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:55.700066 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:55.700487 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:55.751530 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9ad643d3-c076-49db-bf01-ac0ceac4e512 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080582 Sep 09 04:44:55.752226 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 350/701] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:55 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:55.845178 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:55.853018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-63a6c2e0-2ef6-4338-8e98-1f7a76c0ac99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.203096 Sep 09 04:44:55.853644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 352/702] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:55 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:56.362187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:56.362898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:56.369515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:56.370015 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:56.370492 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:56.372245 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:56.372786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:56.373207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:56.525372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:56.533413 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:56.534864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:56.536047 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c13db855-caf4-4b52-b2b0-6cc9bdbcef6d tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.177754 Sep 09 04:44:56.536604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 351/703] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:56 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:56.764772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:56.767155 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:56.773881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:56.774361 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:56.774797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:56.775875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:56.776498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:56.777042 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:56.816176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-94903f5c-bfad-4264-96fd-5f712adea490 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055439 Sep 09 04:44:56.817116 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 353/704] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:56 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:56.876881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:56.877479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:56.884321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:56.884801 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:56.885228 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:56.886126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:56.886968 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:56.887614 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:57.029544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:57.037446 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c122d9ec-47a5-4c92-af9c-d5bb3e6e0987 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.164312 Sep 09 04:44:57.038031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 352/705] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:56 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:57.563660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:57.564185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:57.570686 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:57.571209 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:57.571660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:57.572330 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:57.572776 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:57.573194 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:57.712232 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:57.722294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:57.723809 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:57.724972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9e1f211c-e286-4e63-ab36-ef5ba26eb9cc tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.165995 Sep 09 04:44:57.725561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 354/706] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:57 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:57.831428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:57.833542 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:57.839579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:57.840064 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:57.840499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:57.841184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:57.841637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:57.842059 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:57.870261 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3e842ce8-dcf7-41ba-a0d3-786bf0d3882c tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Sep 09 04:44:57.870797 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 353/707] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:57 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:44:58.063653 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:58.064294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:58.071005 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:58.071485 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:58.071920 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:58.072609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:58.073065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:58.073487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:58.199837 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:58.207501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-69c692d4-7193-413e-b9d8-47edc3c8d7d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.147688 Sep 09 04:44:58.208064 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 355/708] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:58 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:58.750285 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:58.750988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:58.757211 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:58.757687 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:58.758122 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:58.758801 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:58.759280 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:58.759698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:58.884048 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:58.886360 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:58.889548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:58.892704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:58.893253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:58.893689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:58.894378 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:58.894825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:58.895272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:58.897536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:58.898982 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:58.900125 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-48df27f7-706b-49ea-bf97-941ec428ce28 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.153736 Sep 09 04:44:58.900678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 354/709] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:58 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:44:58.924339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b0fca5b5-725d-4dbd-9dc3-c05f3779ac3b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Sep 09 04:44:58.924814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 356/710] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:58 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:44:59.232004 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:59.232582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:59.238528 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:59.239034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:59.239470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:59.240156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:59.240601 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:59.241018 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:59.367826 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:44:59.376182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-797a3a7d-829c-4389-a603-ed06a56dcd02 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.148187 Sep 09 04:44:59.376754 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 355/711] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:44:59 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:44:59.926843 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:59.928050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:59.934667 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:59.935187 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:59.935679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:59.936322 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:44:59.936760 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:59.936858 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:59.937342 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:59.939073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:44:59.947085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:59.947573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:59.948049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:59.948749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:44:59.949275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:44:59.949698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:44:59.979160 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-70b6c2dd-e7c6-42a0-bf64-554c00060b50 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046888 Sep 09 04:44:59.979753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 356/712] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:44:59 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 04:45:00.072028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:00.081012 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:00.082454 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:00.083641 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f3252141-cbe0-4ab1-b096-e20670a667f3 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.161103 Sep 09 04:45:00.084183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 357/713] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:44:59 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:00.097140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:00.099349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:00.105186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.105666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.106098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.106785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.107260 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.107683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.135291 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-51c95668-a7e0-4fd3-9b56-44c76ce129e1 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042147 Sep 09 04:45:00.135835 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 357/714] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:45:00 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 04:45:00.197867 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:00.198376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:00.204771 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.205255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.205704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.206381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.206851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.207286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.232720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:45:00.305958 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a8911a6f-cdf6-41b3-b2d8-c5f3b2a22d21 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 204 len: 0 microversion: 2.1 time: 0.111619 Sep 09 04:45:00.306561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 358/715] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:45:00 2022] DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:45:00.315139 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:00.315746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:00.321881 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.322361 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.322795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.323510 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.323960 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.324898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.399715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:00.400456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:00.407018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.407503 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.407941 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.408746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:00.409228 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:00.409655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:00.464385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:00.466863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:00.474555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-234cebd0-3ced-49a9-ace3-bbc2be52e50b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1674 microversion: 2.1 time: 0.163325 Sep 09 04:45:00.475159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 358/716] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:00 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:00.545123 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:00.552749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e941a606-56af-49b1-a44c-20e7f5df53ae tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.157315 Sep 09 04:45:00.553314 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 359/717] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:00 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:01.110171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:01.110773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:01.117694 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:01.118186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:01.118600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:01.119380 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:01.119760 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:01.120178 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:01.252384 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:01.260472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:01.261915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:01.263086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8f4737ff-92fa-4b3a-b14c-580af0395143 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.157632 Sep 09 04:45:01.263826 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 359/718] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:01 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:01.497327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:01.497856 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:01.504356 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:01.504844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:01.505271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:01.505963 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:01.506415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:01.506840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:01.577044 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:01.577676 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:01.583567 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:01.584145 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:01.584590 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:01.585277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:01.585714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:01.586137 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:01.642543 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:01.646059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:01.651999 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-22a9e19a-4e7a-4c0f-8ce0-244e5d6ce957 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1674 microversion: 2.1 time: 0.158669 Sep 09 04:45:01.653202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 360/719] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:01 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:01.727642 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:01.735440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1a55d0f3-3d7e-4565-8144-40e8a9e2dfd4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.162788 Sep 09 04:45:01.736013 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 360/720] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:01 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:02.289849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:02.290552 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:02.297784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:02.298293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:02.298725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:02.299438 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:02.299886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:02.300307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:02.441944 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:02.449949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:02.451449 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:02.452593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9df2a2e0-df52-497d-9a7e-17304956bfb9 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.167416 Sep 09 04:45:02.453153 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 361/721] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:02 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:02.676326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:02.676932 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:02.683582 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:02.684101 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:02.684544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:02.685240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:02.685692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:02.686116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:02.759028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:02.759909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:02.766287 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:02.766864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:02.767345 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:02.768051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:02.768518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:02.768950 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:02.899971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:02.911243 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ac01c48b-5836-4e7d-b30a-60228914fd22 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1674 microversion: 2.1 time: 0.238601 Sep 09 04:45:02.911897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 361/722] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:02 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:02.948395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:02.956098 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7f244acb-6c64-41b4-92e3-eb8b3f15809c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.201579 Sep 09 04:45:02.956663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 362/723] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:02 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:03.477577 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:03.478178 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:03.484807 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:03.485287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:03.485721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:03.486408 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:03.486856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:03.487303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:03.613139 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:03.621280 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:03.622731 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:03.623924 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bbe87276-5091-43b7-99e1-a5291faa8370 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.150266 Sep 09 04:45:03.624479 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 362/724] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:03 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:03.939600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:03.940215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:03.946849 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:03.947366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:03.947805 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:03.948505 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:03.948961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:03.949876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:03.982222 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:03.982831 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:03.990028 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:03.990863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:03.991324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:03.992028 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:03.992475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:03.992897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:04.139364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:04.147224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-063a2f23-c684-4178-9b0b-e9df02a6ab1b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1674 microversion: 2.1 time: 0.211775 Sep 09 04:45:04.147997 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 363/725] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:03 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:04.166720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:04.174752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4477345c-40eb-4324-aeba-70cff0eea2ed tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.197272 Sep 09 04:45:04.179006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 363/726] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:03 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:04.649208 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:04.649813 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:04.656351 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:04.656999 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:04.657465 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:04.658162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:04.658614 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:04.659061 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:04.784454 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:04.792441 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:04.794378 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:04.795549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1eaf14e6-f750-4213-98df-770772a19135 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.150255 Sep 09 04:45:04.796106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 364/727] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:04 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:05.171580 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:05.172192 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:05.178546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:05.179058 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:05.179501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:05.180197 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:05.180654 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:05.181083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:05.197660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:05.198269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:05.204534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:05.205015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:05.205453 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:05.206148 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:05.206609 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:05.207063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:05.442492 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:05.449487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:05.457428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-473b9f86-0c04-4b23-9e88-265e66a34617 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1674 microversion: 2.1 time: 0.289745 Sep 09 04:45:05.457621 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cbb40e81-8b76-45ee-99f3-efa58ee4eee9 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1681 microversion: 2.1 time: 0.263418 Sep 09 04:45:05.457902 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 365/728] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:05 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:05.458992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 364/729] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:05 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1674 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:05.822179 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:05.823117 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:05.829198 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:05.829685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:05.830124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:05.830862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:05.831362 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:05.831786 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:05.962973 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-10e28bce-4348-4b07-b2e0-b662107c9019 req-fc1b6aed-75c0-44b2-a23c-9673d941a363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88adb310-4be0-4b55-a3f9-65fe75a17959", "name": "network-vif-plugged", "status": "completed", "tag": "ffb258f4-dc03-4824-b22c-0f1742f0ed65"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:05.993511 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-10e28bce-4348-4b07-b2e0-b662107c9019 req-fc1b6aed-75c0-44b2-a23c-9673d941a363 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:05.996850 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-10e28bce-4348-4b07-b2e0-b662107c9019 req-fc1b6aed-75c0-44b2-a23c-9673d941a363 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:05.997340 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-10e28bce-4348-4b07-b2e0-b662107c9019 req-fc1b6aed-75c0-44b2-a23c-9673d941a363 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:06.021961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-10e28bce-4348-4b07-b2e0-b662107c9019 req-fc1b6aed-75c0-44b2-a23c-9673d941a363 service nova] Creating event network-vif-plugged:ffb258f4-dc03-4824-b22c-0f1742f0ed65 for instance 88adb310-4be0-4b55-a3f9-65fe75a17959 on hv-cinder-85600 Sep 09 04:45:06.030801 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-10e28bce-4348-4b07-b2e0-b662107c9019 req-fc1b6aed-75c0-44b2-a23c-9673d941a363 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078186 Sep 09 04:45:06.032171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 365/730] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:06.071919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:06.082168 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:06.083884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:06.085095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c4416492-5a15-4823-b60e-ca5a24013a64 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.267371 Sep 09 04:45:06.099132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 366/731] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:05 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:06.481905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:06.482707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:06.483894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:06.485258 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:06.492579 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:06.495457 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:06.496385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:06.500894 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:06.501577 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:06.501851 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:06.502318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:06.502949 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:06.504244 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:06.505416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:06.507255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:06.507889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:06.673750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:06.683852 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1875cca4-8cad-462d-bc6f-8d9e3c24d210 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1613 microversion: 2.1 time: 0.205990 Sep 09 04:45:06.693694 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 367/732] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:06 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1613 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:06.783172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:06.795877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4e73a9d3-c742-44ab-964a-41cd7e20123b tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1674 microversion: 2.1 time: 0.318274 Sep 09 04:45:06.804910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-acd1d0ac-9d2b-4aaf-9421-9a46fe745782 req-4905e6c6-17d1-4c47-959c-39868f56a1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f332a8b8-4ec7-43ee-b027-ee59bbd0763a", "name": "network-vif-deleted", "tag": "bd531f49-8a3c-4043-8dbe-1431619cc92e"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:06.814560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 366/733] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:06 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1674 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:06.831541 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-acd1d0ac-9d2b-4aaf-9421-9a46fe745782 req-4905e6c6-17d1-4c47-959c-39868f56a1ed service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:06.832893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-acd1d0ac-9d2b-4aaf-9421-9a46fe745782 req-4905e6c6-17d1-4c47-959c-39868f56a1ed service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:06.834063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-acd1d0ac-9d2b-4aaf-9421-9a46fe745782 req-4905e6c6-17d1-4c47-959c-39868f56a1ed service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:06.859640 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-acd1d0ac-9d2b-4aaf-9421-9a46fe745782 req-4905e6c6-17d1-4c47-959c-39868f56a1ed service nova] Creating event network-vif-deleted:bd531f49-8a3c-4043-8dbe-1431619cc92e for instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a on hv-cinder-85600 Sep 09 04:45:06.865188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-acd1d0ac-9d2b-4aaf-9421-9a46fe745782 req-4905e6c6-17d1-4c47-959c-39868f56a1ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169870 Sep 09 04:45:06.869481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 368/734] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:07.111484 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:07.112458 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:07.118678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.119198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.119643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.120352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.121576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.122014 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.279598 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:07.290454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:07.291987 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:07.293995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1806f5cd-0495-439a-b0ed-2222a60ee9bb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.186243 Sep 09 04:45:07.308594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 367/735] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:07 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:07.503679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-91284b38-4f1e-400e-8a13-ed12b2fc068c req-5bcd5f65-78a7-4a77-8696-ad3bc4e862aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51d5f24-f47e-4dd9-9948-81bfa8ed97dc", "name": "network-vif-deleted", "tag": "a3fff027-2bdc-4c7e-a679-5b611770f4c2"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:07.515169 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-91284b38-4f1e-400e-8a13-ed12b2fc068c req-5bcd5f65-78a7-4a77-8696-ad3bc4e862aa service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.515795 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-91284b38-4f1e-400e-8a13-ed12b2fc068c req-5bcd5f65-78a7-4a77-8696-ad3bc4e862aa service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.516555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-91284b38-4f1e-400e-8a13-ed12b2fc068c req-5bcd5f65-78a7-4a77-8696-ad3bc4e862aa service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.531841 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-91284b38-4f1e-400e-8a13-ed12b2fc068c req-5bcd5f65-78a7-4a77-8696-ad3bc4e862aa service nova] Creating event network-vif-deleted:a3fff027-2bdc-4c7e-a679-5b611770f4c2 for instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc on hv-cinder-85600 Sep 09 04:45:07.539396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-91284b38-4f1e-400e-8a13-ed12b2fc068c req-5bcd5f65-78a7-4a77-8696-ad3bc4e862aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096854 Sep 09 04:45:07.540035 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 369/736] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:45:07.718761 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:07.721583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:07.731701 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.733116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.733927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.734648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.735349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.736012 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.776967 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.777652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.778312 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.779020 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'fault' on Instance uuid f332a8b8-4ec7-43ee-b027-ee59bbd0763a {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:45:07.821777 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:07.822487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:07.829498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.829993 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.830434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.831177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:07.831631 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:07.832063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:07.839747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:07.848079 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fb34774d-0385-4161-8376-b9f9fd49bb24 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 200 len: 1330 microversion: 2.1 time: 0.136465 Sep 09 04:45:07.848667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 368/737] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:07 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:07.902830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:07.910910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fdcf9509-8707-47a2-86d3-faa50cba24bd tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1321 microversion: 2.1 time: 0.093933 Sep 09 04:45:07.911565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 370/738] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:07 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:08.320976 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:08.321595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:08.328147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:08.328585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:08.329030 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:08.329716 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:08.330168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:08.330596 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:08.463592 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:08.472491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:08.474042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:08.475225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0200105c-ec00-4587-9751-29c8f6cc5bc8 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1731 microversion: 2.20 time: 0.158232 Sep 09 04:45:08.475905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 369/739] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:08 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:08.873471 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:08.875447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:08.884513 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:08.885494 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:08.886188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:08.887711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:08.888322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:08.888905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:08.905498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a HTTP/1.1 Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:45:08.907467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:45:08.909406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'f332a8b8-4ec7-43ee-b027-ee59bbd0763a'} Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:08.910486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:45:08.912308 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:08.914288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:08.914288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-922ac3f1-e664-4de0-bfee-0deecaaa7ef6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 404 len: 111 microversion: 2.1 time: 0.039948 Sep 09 04:45:08.914288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 371/740] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:08 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 04:45:08.918047 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7d506ca5-b585-4c7d-bf34-da6933499035 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '.version_select at 0x7f43fabf2430>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:08.934244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:08.934982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:08.940351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7d506ca5-b585-4c7d-bf34-da6933499035 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-213649908" status: 202 len: 0 microversion: 2.1 time: 0.025796 Sep 09 04:45:08.942169 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 370/741] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 04:45:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-213649908 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:45:08.944582 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:08.945964 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:08.946452 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:08.947840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:08.948389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:08.950113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:09.000211 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:09.000863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:09.001306 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:09.001797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lazy-loading 'fault' on Instance uuid d51d5f24-f47e-4dd9-9948-81bfa8ed97dc {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:45:09.052548 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf68e214fd4740be96f2d6c4325f6ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad09c9b062641c19d3811d5c96a24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:09.061967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b890e338-c1b7-4dc8-ae4b-8a73b26efca5 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 200 len: 1326 microversion: 2.1 time: 0.132132 Sep 09 04:45:09.062733 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 372/742] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:08 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:09.501907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:09.502889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:09.510847 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:09.512026 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:09.512708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:09.513638 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:09.514313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:09.514994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:09.699985 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:09.709772 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:09.712437 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:09.715143 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5adc48be-2a87-4b92-9c41-fa676fb2fe1f tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1718 microversion: 2.20 time: 0.215702 Sep 09 04:45:09.715888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 371/743] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:09 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1718 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:09.751852 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b6b07278-235a-41a6-b59d-b42aeb62adb2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: .version_select at 0x7f43facd8280>, body: {"keypair": {"name": "tempest-keypair-1552536664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt0CU810PpLVGfpr0OHi4k/raN52Zb+BmNOkIhaAB5pyMn3ME7C13Bf2x74I6G+fnajRbo8cLNjWqzVziO3BqgIrl8VMpaKx0PYJ/9F8R9sX3AvQKbNZ5vddYtkSAma4g=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:09.768386 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-b6b07278-235a-41a6-b59d-b42aeb62adb2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:45:09.772281 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-b6b07278-235a-41a6-b59d-b42aeb62adb2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:45:09.799512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b6b07278-235a-41a6-b59d-b42aeb62adb2 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051430 Sep 09 04:45:09.800162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 373/744] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:45:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:10.100600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:10.101219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:10.108130 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:10.108621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:10.109279 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:10.109983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:10.110637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:10.111282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:10.125875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] HTTP exception thrown: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Request method failure captured: Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc HTTP/1.1 Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNxnzEjA1VfLDpIT81mdfxqrqWwnMh-yxCKpbHJgfsoeGF6-6A--Vpr_spmhEy9SikXzV6Z7cO-KG1zkajzozvtxYInBVc8Qd-ln7VOeT95VTY5A-SPU4y80qVVk0dx56S7jbG8OdBNja1vnF5Z-_OYp8qhpfp7VgsgiJWUTVajfFs Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:45:10.127561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}] Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: bf68e214fd4740be96f2d6c4325f6ee9 Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:10.128936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'd51d5f24-f47e-4dd9-9948-81bfa8ed97dc'} Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:10.129707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:10.131105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:10.132213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Returning 404 to user: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:10.132213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-cada3712-84a0-4fcb-9e81-6b21946341e0 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 404 len: 111 microversion: 2.1 time: 0.043670 Sep 09 04:45:10.133646 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 372/745] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:10 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:45:10.139432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fb0832c9-39a0-4038-b91f-ccc1b3056aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '.version_select at 0x7f43fac42310>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:10.157085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:10.168816 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fb0832c9-39a0-4038-b91f-ccc1b3056aed tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488817362" status: 202 len: 0 microversion: 2.1 time: 0.034274 Sep 09 04:45:10.169644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 374/746] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Sep 9 04:45:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488817362 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:45:11.304995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111348993", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0"}], "security_groups": [{"name": "tempest-securitygroup--732372754"}], "key_name": "tempest-keypair-1552536664", "user_data": "}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:11.412164 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] validate_networks() for [('38eaff98-5ff6-4a1f-8cce-6a1e87a00bb0', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:45:11.991552 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1892297171", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:12.042249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] validate_networks() for None {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:45:12.271067 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:45:12.271621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:45:12.272155 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:45:12.272655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:45:12.273065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:45:12.282662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:12.283100 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:12.283533 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:12.284256 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:12.284706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:12.285130 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:12.301552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:45:12.305453 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Getting quotas for user 2decd678421e4231bb3b58cd57d600bc and project 91bb02023bea4020ba1066ba4c85ff4d. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:45:12.317040 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:45:12.319429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:45:12.372671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2ac4461f-92bf-44ab-aa30-111149771403 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.071532 Sep 09 04:45:12.373324 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 373/747] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:45:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:45:12.383081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:45:12.384829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:45:12.385603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b9a1a835-766f-41e0-b768-1e6a6d33e8cd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:12.386174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:45:12.387023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b9a1a835-766f-41e0-b768-1e6a6d33e8cd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:12.387598 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:45:12.388258 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:45:12.391110 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:12.403008 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:12.403649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:12.404364 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:12.405519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:12.406242 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:12.406908 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:12.453701 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Getting quotas for project 1461fc5c46f8433ebb5a9faa6d946b2f. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:45:12.454830 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b9a1a835-766f-41e0-b768-1e6a6d33e8cd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:12.458792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Getting quotas for user c4c3d3df03944261acebdeac5d4154d7 and project 1461fc5c46f8433ebb5a9faa6d946b2f. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:45:12.465296 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b9a1a835-766f-41e0-b768-1e6a6d33e8cd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1242 microversion: 2.1 time: 0.083689 Sep 09 04:45:12.470648 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:45:12.473124 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:45:12.475610 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 374/748] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:12 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:12.528406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-90f291ef-cb58-49ec-8cf3-cf2704db90cf tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540190 Sep 09 04:45:12.529256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 375/749] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:45:12.540464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3bfe97d6-3b9c-4efc-a954-ccf34a95fcd0 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:12.541106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3bfe97d6-3b9c-4efc-a954-ccf34a95fcd0 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:12.598777 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3bfe97d6-3b9c-4efc-a954-ccf34a95fcd0 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:12.606834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3bfe97d6-3b9c-4efc-a954-ccf34a95fcd0 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1215 microversion: 2.1 time: 0.070361 Sep 09 04:45:12.607864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 375/750] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:12 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:13.220463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:13.221653 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:13.229664 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.230853 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.231322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.232077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.232529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.232951 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.246592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] HTTP exception thrown: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Request method failure captured: Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc HTTP/1.1 Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNxnzEjA1VfLDpIT81mdfxqrqWwnMh-yxCKpbHJgfsoeGF6-6A--Vpr_spmhEy9SikXzV6Z7cO-KG1zkajzozvtxYInBVc8Qd-ln7VOeT95VTY5A-SPU4y80qVVk0dx56S7jbG8OdBNja1vnF5Z-_OYp8qhpfp7VgsgiJWUTVajfFs Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:45:13.248176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}] Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: bf68e214fd4740be96f2d6c4325f6ee9 Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.249573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'd51d5f24-f47e-4dd9-9948-81bfa8ed97dc'} Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:13.250630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.252688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.254587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Returning 404 to user: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:13.254587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-42fc17de-9fe6-4e0e-8b66-dafbef6ae52e tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 404 len: 111 microversion: 2.1 time: 0.032967 Sep 09 04:45:13.254587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 376/751] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:45:13 2022] DELETE /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:45:13.260068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:13.260708 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: d51d5f24-f47e-4dd9-9948-81bfa8ed97dc] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:13.268329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.268824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.269267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.269974 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.270430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.270856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.284755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] HTTP exception thrown: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Request method failure captured: Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc HTTP/1.1 Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNxnzEjA1VfLDpIT81mdfxqrqWwnMh-yxCKpbHJgfsoeGF6-6A--Vpr_spmhEy9SikXzV6Z7cO-KG1zkajzozvtxYInBVc8Qd-ln7VOeT95VTY5A-SPU4y80qVVk0dx56S7jbG8OdBNja1vnF5Z-_OYp8qhpfp7VgsgiJWUTVajfFs Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:45:13.286313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}] Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: bf68e214fd4740be96f2d6c4325f6ee9 Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.287905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'd51d5f24-f47e-4dd9-9948-81bfa8ed97dc'} Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:13.288724 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. Sep 09 04:45:13.290141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:13.291409 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Returning 404 to user: Instance d51d5f24-f47e-4dd9-9948-81bfa8ed97dc could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:13.291409 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7818d33a-ed63-4d43-a164-5fef4e9e5356 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc" status: 404 len: 111 microversion: 2.1 time: 0.031732 Sep 09 04:45:13.291409 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 376/752] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:13 2022] GET /compute/v2.1/servers/d51d5f24-f47e-4dd9-9948-81bfa8ed97dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:45:13.487797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:13.488399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:13.494249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.494722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.495191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.495900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.496346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.496765 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.564030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:13.572132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-526e2729-62c7-478a-a4a5-a27baf63aa61 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1294 microversion: 2.1 time: 0.088145 Sep 09 04:45:13.572971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 377/753] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:13 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:13.630376 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:13.631025 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:13.638008 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.638716 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.639400 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.640170 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:13.640828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:13.641126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:13.710185 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:13.721373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-600b722b-8c70-4e77-b60d-b8604af6bc71 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1211 microversion: 2.1 time: 0.094824 Sep 09 04:45:13.722680 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 377/754] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:13 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:14.436216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:14.437631 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:14.445427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.445911 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.446525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.447289 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.459542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.459994 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.474758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] HTTP exception thrown: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Request method failure captured: Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: DELETE /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 HTTP/1.1 Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNxnzEjA1VfLDpIT81mdfxqrqWwnMh-yxCKpbHJgfsoeGF6-6A--Vpr_spmhEy9SikXzV6Z7cO-KG1zkajzozvtxYInBVc8Qd-ln7VOeT95VTY5A-SPU4y80qVVk0dx56S7jbG8OdBNja1vnF5Z-_OYp8qhpfp7VgsgiJWUTVajfFs Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:45:14.476711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}] Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: bf68e214fd4740be96f2d6c4325f6ee9 Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.477998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '4ee805de-a9e3-4596-9b43-d7cdc17b9e96'} Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:14.478729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.480463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.481642 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Returning 404 to user: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:14.481642 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-14faa3ef-1bee-4491-955a-b23e818d7a17 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 404 len: 111 microversion: 2.1 time: 0.047298 Sep 09 04:45:14.481642 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 378/755] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:45:14 2022] DELETE /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:45:14.487355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:14.488277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] [instance: 4ee805de-a9e3-4596-9b43-d7cdc17b9e96] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:14.497043 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.497812 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.498603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.499665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.500311 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.500972 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.515446 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] HTTP exception thrown: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Request method failure captured: Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 HTTP/1.1 Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNxnzEjA1VfLDpIT81mdfxqrqWwnMh-yxCKpbHJgfsoeGF6-6A--Vpr_spmhEy9SikXzV6Z7cO-KG1zkajzozvtxYInBVc8Qd-ln7VOeT95VTY5A-SPU4y80qVVk0dx56S7jbG8OdBNja1vnF5Z-_OYp8qhpfp7VgsgiJWUTVajfFs Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:45:14.517585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ad09c9b062641c19d3811d5c96a24f8"}]}] Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 7ad09c9b062641c19d3811d5c96a24f8 Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeTestJSON-256843383 Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: bf68e214fd4740be96f2d6c4325f6ee9 Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeTestJSON-256843383-project Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.519068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '4ee805de-a9e3-4596-9b43-d7cdc17b9e96'} Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:14.519998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. Sep 09 04:45:14.521753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:14.523532 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] Returning 404 to user: Instance 4ee805de-a9e3-4596-9b43-d7cdc17b9e96 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:14.523532 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-008bb970-47d7-433e-ba39-a1b5a68702d4 tempest-AttachVolumeTestJSON-256843383 tempest-AttachVolumeTestJSON-256843383-project] 10.222.0.20 "GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96" status: 404 len: 111 microversion: 2.1 time: 0.035600 Sep 09 04:45:14.523532 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 378/756] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:14 2022] GET /compute/v2.1/servers/4ee805de-a9e3-4596-9b43-d7cdc17b9e96 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:45:14.595650 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:14.596510 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:14.602893 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.603499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.604040 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.604822 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.605903 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.606412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.746676 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:14.747329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:14.766323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.767157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.768207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.769165 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:14.769827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:14.770624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:14.901451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:14.911374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7218e3d0-a021-4da7-a3e5-374ec15b9efb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1273 microversion: 2.1 time: 0.168648 Sep 09 04:45:14.913263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 379/757] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:14 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:14.973611 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:14.983193 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-ae509b4b-4989-4c98-b66f-a68d3743ca99 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.391518 Sep 09 04:45:14.983758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 379/758] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:14 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:15.935387 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:15.936658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:15.943451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:15.944171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:15.944604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:15.945469 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:15.945926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:15.946352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:16.005947 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:16.007401 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:16.016331 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:16.017280 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:16.017724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:16.018433 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:16.019052 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:16.019483 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:16.032093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:16.043280 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-24eeefda-2b95-4272-b21b-bb9385192f0c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1273 microversion: 2.1 time: 0.111605 Sep 09 04:45:16.046667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 380/759] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:15 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:16.248885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-b38fcfab-713e-4833-aa31-ee15d923b8e4 req-7f2f821e-54a8-45a8-a621-6ad7713db5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da0d58c-a9aa-4b45-b128-4bc6d684f7d8", "tag": "19a6f675-87b2-4f03-b050-d4981330ff5e"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:16.265985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:16.270157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-b38fcfab-713e-4833-aa31-ee15d923b8e4 req-7f2f821e-54a8-45a8-a621-6ad7713db5e6 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:16.270854 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-b38fcfab-713e-4833-aa31-ee15d923b8e4 req-7f2f821e-54a8-45a8-a621-6ad7713db5e6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:16.272797 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-b38fcfab-713e-4833-aa31-ee15d923b8e4 req-7f2f821e-54a8-45a8-a621-6ad7713db5e6 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:16.275944 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-271a9962-9a5f-43ec-ace6-cb30b9b66691 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.274049 Sep 09 04:45:16.277160 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 380/760] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:16 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:16.302187 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-b38fcfab-713e-4833-aa31-ee15d923b8e4 req-7f2f821e-54a8-45a8-a621-6ad7713db5e6 service nova] Creating event network-changed:19a6f675-87b2-4f03-b050-d4981330ff5e for instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 on hv-cinder-85600 Sep 09 04:45:16.309297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-b38fcfab-713e-4833-aa31-ee15d923b8e4 req-7f2f821e-54a8-45a8-a621-6ad7713db5e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063991 Sep 09 04:45:16.310472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 381/761] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:45:17.072328 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:17.072954 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:17.079688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:17.080363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:17.081140 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:17.082374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:17.083217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:17.083790 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:17.222895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:17.231090 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-96070caa-46d6-4fb8-bcd2-b81e094d5ad4 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.162739 Sep 09 04:45:17.231668 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 381/762] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:17 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:17.306495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:17.307929 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:17.314028 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:17.314453 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:17.314886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:17.315600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:17.316304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:17.316728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:17.320734 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:17.508869 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:17.517503 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-515acd60-fc86-4680-a4b4-d923512e7e71 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.215686 Sep 09 04:45:17.518227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 382/763] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:17 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:18.253720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:18.256409 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:18.268606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:18.271501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:18.272073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:18.272945 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:18.274873 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:18.275655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:18.344557 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-3be14078-3cf9-4047-a58c-12602696b333 req-48499c5b-1643-41a2-976a-bf8ca0993f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b667ba59-f035-48d3-9294-15fa44cf50df", "tag": "48ee6eb2-7391-492a-a7d8-e2d55e18c4fa"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:18.360875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3be14078-3cf9-4047-a58c-12602696b333 req-48499c5b-1643-41a2-976a-bf8ca0993f2c service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:18.361626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3be14078-3cf9-4047-a58c-12602696b333 req-48499c5b-1643-41a2-976a-bf8ca0993f2c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:18.362265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3be14078-3cf9-4047-a58c-12602696b333 req-48499c5b-1643-41a2-976a-bf8ca0993f2c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:18.382794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-3be14078-3cf9-4047-a58c-12602696b333 req-48499c5b-1643-41a2-976a-bf8ca0993f2c service nova] Creating event network-changed:48ee6eb2-7391-492a-a7d8-e2d55e18c4fa for instance b667ba59-f035-48d3-9294-15fa44cf50df on hv-cinder-85600 Sep 09 04:45:18.389299 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-3be14078-3cf9-4047-a58c-12602696b333 req-48499c5b-1643-41a2-976a-bf8ca0993f2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048952 Sep 09 04:45:18.390134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 383/764] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:18.507185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:18.515216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-dc2ec386-5694-49b6-8e42-e7d9834cf947 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.265385 Sep 09 04:45:18.516482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 382/765] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:18 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:18.541913 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:18.543191 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:18.549425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:18.549918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:18.550412 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:18.551149 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:18.551604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:18.552030 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:18.793918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:18.803220 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c0d95ad7-ec79-4e49-ab32-890661bc3646 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.265849 Sep 09 04:45:18.804310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 384/766] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:18 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:19.539922 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:19.540538 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:19.547401 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:19.547881 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:19.548317 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:19.549017 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:19.549469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:19.549889 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:19.553866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:19.706468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:19.714223 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f1ea06fe-4fe1-442f-8e93-8ce2375c887a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.178140 Sep 09 04:45:19.714799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 383/767] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:19 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:19.827721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:19.828358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:19.834736 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:19.835250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:19.835687 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:19.836385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:19.836834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:19.837255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:19.974191 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:19.983047 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4e5be02d-7b05-4eec-a145-fe2fd5b22716 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.159013 Sep 09 04:45:19.983677 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 385/768] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:19 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:20.737439 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:20.738044 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:20.744504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:20.744927 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:20.745375 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:20.746076 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:20.746526 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:20.746963 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:20.877479 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:20.884937 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b3216933-9b3a-431f-ac46-390f51def6ca tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.151350 Sep 09 04:45:20.885498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 384/769] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:20 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:21.005511 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:21.006117 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:21.012462 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:21.012873 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:21.013304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:21.013981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:21.014427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:21.014842 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:21.405035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:21.412595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4db2700e-5fd7-4083-aa3e-2517aec9fefe tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.410886 Sep 09 04:45:21.413151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 386/770] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:21 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:21.791803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8db5886e-9c8c-477b-ab62-da9801922cd9 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fabb25e0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:21.839356 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8db5886e-9c8c-477b-ab62-da9801922cd9 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8de20c57-8bb2-4937-af8a-ca6f5f018eaa" status: 200 len: 351 microversion: 2.1 time: 0.051179 Sep 09 04:45:21.839919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 385/771] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:45:21 2022] GET /compute/v2.1/os-volumes/8de20c57-8bb2-4937-af8a-ca6f5f018eaa => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:21.907391 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:21.908083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:21.918019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:21.919198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:21.919698 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:21.920602 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:21.921250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:21.922150 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:22.063902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:22.075888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f0e3d95b-da1f-474f-8b32-425a816d63dd tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.170958 Sep 09 04:45:22.076570 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 387/772] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:21 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:22.435778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:22.436382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:22.443450 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:22.443947 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:22.444385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:22.445396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:22.445850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:22.446270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:22.446706 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:22.466958 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=10 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:22.577512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:22.585075 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-13889c89-2730-4875-bea7-cfd9e0fc5e49 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.153615 Sep 09 04:45:22.585636 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 386/773] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:22 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:23.098009 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:23.098707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:23.102098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:23.102856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=10 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:23.107759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:23.108248 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:23.108679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:23.109416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:23.109864 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:23.110280 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:23.244575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:23.259619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-adeb2f84-46a1-4f20-9837-3ee7b3515ba2 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.165485 Sep 09 04:45:23.261224 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 388/774] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:23 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:23.280982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9d1b45a5-817e-47b6-bf02-d60a2c540677 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fac3e8b0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:23.328094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9d1b45a5-817e-47b6-bf02-d60a2c540677 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/583dfa50-fb6e-4ede-824b-d57b9d11109f" status: 200 len: 351 microversion: 2.1 time: 0.050869 Sep 09 04:45:23.328657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 387/775] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:45:23 2022] GET /compute/v2.1/os-volumes/583dfa50-fb6e-4ede-824b-d57b9d11109f => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:23.609301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:23.609936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:23.616152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:23.616635 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:23.617109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:23.617758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:23.618198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:23.618621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:23.753228 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:23.760730 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d2615f19-71bd-4bf9-abaa-b6e3f1be19d7 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.155911 Sep 09 04:45:23.761299 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 389/776] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:23 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:24.283735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:24.284359 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:24.290707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:24.291245 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:24.291685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:24.292416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:24.292871 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:24.293296 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:24.392781 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-9c0b904f-000b-406a-bab5-713c067aeab6 req-172b6082-d6ee-4061-96c3-432dd0642a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da0d58c-a9aa-4b45-b128-4bc6d684f7d8", "name": "network-vif-plugged", "status": "completed", "tag": "19a6f675-87b2-4f03-b050-d4981330ff5e"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:24.404541 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-9c0b904f-000b-406a-bab5-713c067aeab6 req-172b6082-d6ee-4061-96c3-432dd0642a81 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:24.405356 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-9c0b904f-000b-406a-bab5-713c067aeab6 req-172b6082-d6ee-4061-96c3-432dd0642a81 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:24.405863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-9c0b904f-000b-406a-bab5-713c067aeab6 req-172b6082-d6ee-4061-96c3-432dd0642a81 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:24.418445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-9c0b904f-000b-406a-bab5-713c067aeab6 req-172b6082-d6ee-4061-96c3-432dd0642a81 service nova] Creating event network-vif-plugged:19a6f675-87b2-4f03-b050-d4981330ff5e for instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 on hv-cinder-85600 Sep 09 04:45:24.426761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:24.429379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-9c0b904f-000b-406a-bab5-713c067aeab6 req-172b6082-d6ee-4061-96c3-432dd0642a81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035996 Sep 09 04:45:24.430174 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 390/777] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:45:24.434966 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-143c11e5-b1a9-464e-bc8f-4e94d1574b69 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.156245 Sep 09 04:45:24.435523 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 388/778] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:24 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:24.669161 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-29d16637-27ad-44ed-8406-0036b5718fda tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fabc6700>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:24.717255 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-29d16637-27ad-44ed-8406-0036b5718fda tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f07a1928-efed-466d-bd03-197477bb8c72" status: 200 len: 351 microversion: 2.1 time: 0.055404 Sep 09 04:45:24.717818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 391/779] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:45:24 2022] GET /compute/v2.1/os-volumes/f07a1928-efed-466d-bd03-197477bb8c72 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:24.730684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0c3524b4-5e84-47ba-a21e-fdb276813707 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fac06ca0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:24.782503 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:24.783250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:24.789570 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:24.790064 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:24.790509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:24.791249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:24.791727 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:24.792186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:24.812830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0c3524b4-5e84-47ba-a21e-fdb276813707 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085792 Sep 09 04:45:24.813480 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 389/780] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Sep 9 04:45:24 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:24.827588 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-bacce94d-3733-4ff6-a1de-190bb6cc5818 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fac4b0d0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:24.909379 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-bacce94d-3733-4ff6-a1de-190bb6cc5818 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085356 Sep 09 04:45:24.910148 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 390/781] 10.222.0.20 () {58 vars in 1149 bytes} [Fri Sep 9 04:45:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:24.924329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:24.924482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5185396b-49f5-4871-8a82-c5519b37012e tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fac0e700>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:24.932196 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7a797abe-ebde-41c9-8f80-63fe97fdaac0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.153454 Sep 09 04:45:24.936990 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 392/782] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:24 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:25.006598 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5185396b-49f5-4871-8a82-c5519b37012e tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086547 Sep 09 04:45:25.007224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 391/783] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Sep 9 04:45:24 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:25.020173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0a3c9cb9-f7d6-4577-9fb1-4e5819d91708 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fac55f70>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:25.102633 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0a3c9cb9-f7d6-4577-9fb1-4e5819d91708 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086088 Sep 09 04:45:25.103311 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 393/784] 10.222.0.20 () {58 vars in 1167 bytes} [Fri Sep 9 04:45:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:25.117484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cc3bacf8-6356-4d89-9b49-fe346988c5c5 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43facd88b0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:25.196641 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cc3bacf8-6356-4d89-9b49-fe346988c5c5 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082802 Sep 09 04:45:25.197251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 392/785] 10.222.0.20 () {58 vars in 1170 bytes} [Fri Sep 9 04:45:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:25.210893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-85f31a77-d879-4b38-b795-c39f3b006099 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fac133a0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:25.292094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-85f31a77-d879-4b38-b795-c39f3b006099 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084926 Sep 09 04:45:25.292653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 394/786] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Sep 9 04:45:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:25.307132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-10ffad89-0c08-4c5b-9943-e521cab67131 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fabb2310>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:25.388123 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-10ffad89-0c08-4c5b-9943-e521cab67131 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085140 Sep 09 04:45:25.388722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 393/787] 10.222.0.20 () {58 vars in 1188 bytes} [Fri Sep 9 04:45:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:25.402287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7ec0c1d7-461a-4617-8f36-fe488fd6af38 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] Calling method '.version_select at 0x7f43fab8b0d0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:25.458583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:25.459237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:25.465311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:25.465830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:25.466272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:25.466986 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:25.468018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:25.468457 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:25.486348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7ec0c1d7-461a-4617-8f36-fe488fd6af38 tempest-VolumesTestJSON-1372621435 tempest-VolumesTestJSON-1372621435-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087661 Sep 09 04:45:25.486921 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 395/788] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Sep 9 04:45:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:25.613011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:25.613011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-633e8912-bd3f-4a83-8975-259c1659230a tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.157306 Sep 09 04:45:25.613011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 394/789] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:25 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:25.956714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:25.957328 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:25.963399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:25.963874 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:25.964308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:25.964994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:25.965442 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:25.965865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:26.091460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:26.099059 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-425f09d3-3b35-4c84-87d8-a72ffbe314ca tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1367 microversion: 2.1 time: 0.146217 Sep 09 04:45:26.099616 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 396/790] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:25 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:26.459144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-1b556734-e872-40af-ad49-e2e112f31c9c req-9c6f08b2-83c2-4810-8872-b768e6a7b22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b667ba59-f035-48d3-9294-15fa44cf50df", "name": "network-vif-plugged", "status": "completed", "tag": "48ee6eb2-7391-492a-a7d8-e2d55e18c4fa"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:26.469006 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-1b556734-e872-40af-ad49-e2e112f31c9c req-9c6f08b2-83c2-4810-8872-b768e6a7b22e service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:26.469481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-1b556734-e872-40af-ad49-e2e112f31c9c req-9c6f08b2-83c2-4810-8872-b768e6a7b22e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:26.469916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-1b556734-e872-40af-ad49-e2e112f31c9c req-9c6f08b2-83c2-4810-8872-b768e6a7b22e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:26.480768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-1b556734-e872-40af-ad49-e2e112f31c9c req-9c6f08b2-83c2-4810-8872-b768e6a7b22e service nova] Creating event network-vif-plugged:48ee6eb2-7391-492a-a7d8-e2d55e18c4fa for instance b667ba59-f035-48d3-9294-15fa44cf50df on hv-cinder-85600 Sep 09 04:45:26.486083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-1b556734-e872-40af-ad49-e2e112f31c9c req-9c6f08b2-83c2-4810-8872-b768e6a7b22e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Sep 09 04:45:26.486673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 395/791] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:26.634077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:26.634679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:26.647986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:26.648773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:26.649227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:26.649978 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:26.650430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:26.650867 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:26.798652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:26.806304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a776afc9-dffd-44f6-b5a6-0332bc7bcd89 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1315 microversion: 2.1 time: 0.176027 Sep 09 04:45:26.806872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 397/792] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:26 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:27.122132 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:27.122823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:27.128897 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:27.129408 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:27.129848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:27.130531 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:27.130998 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:27.131424 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:27.258306 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:27.266514 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5ec06bbd-d83b-4c41-8bcb-4eff11bf3347 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1558 microversion: 2.1 time: 0.148563 Sep 09 04:45:27.267131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 396/793] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:27 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:27.288751 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:27.289238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:27.295343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:27.295823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:27.296254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:27.296933 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:27.297384 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:27.297804 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:27.372356 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ade18aee-a465-428f-8a36-219aa00d6e6f tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087347 Sep 09 04:45:27.372959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 398/794] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Sep 9 04:45:27 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:27.828905 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:27.829423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:27.835872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:27.836575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:27.837007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:27.837701 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:27.838312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:27.838735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:28.087796 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:28.095910 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c2e90047-78a6-453f-ba0b-1f29adce0c08 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1465 microversion: 2.1 time: 0.271412 Sep 09 04:45:28.096483 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 397/795] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:27 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1465 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:28.144722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:28.145400 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:28.151115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:28.151598 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:28.152024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:28.152709 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:28.153156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:28.153587 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:28.180178 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:45:28.258078 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3109aa58-2b2d-4ee0-b720-74520cf5f205 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 204 len: 0 microversion: 2.1 time: 0.117630 Sep 09 04:45:28.258915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 399/796] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:45:28 2022] DELETE /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:45:28.269552 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:28.270235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:28.276450 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:28.276952 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:28.277658 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:28.278456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:28.279001 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:28.280284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:28.488931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-e4727d74-ad6d-4d42-a131-a25415c49d5d req-d04f8b6e-44b6-4d61-a026-5af0ab1367bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da0d58c-a9aa-4b45-b128-4bc6d684f7d8", "tag": "19a6f675-87b2-4f03-b050-d4981330ff5e"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:28.489566 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:28.497821 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d68b8158-d612-43e9-95d5-9b41f99c5fcb tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1471 microversion: 2.1 time: 0.234753 Sep 09 04:45:28.498974 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-e4727d74-ad6d-4d42-a131-a25415c49d5d req-d04f8b6e-44b6-4d61-a026-5af0ab1367bf service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:28.499702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-e4727d74-ad6d-4d42-a131-a25415c49d5d req-d04f8b6e-44b6-4d61-a026-5af0ab1367bf service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:28.500277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-e4727d74-ad6d-4d42-a131-a25415c49d5d req-d04f8b6e-44b6-4d61-a026-5af0ab1367bf service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:28.510335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 398/797] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:28 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:45:28.511997 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-e4727d74-ad6d-4d42-a131-a25415c49d5d req-d04f8b6e-44b6-4d61-a026-5af0ab1367bf service nova] Creating event network-changed:19a6f675-87b2-4f03-b050-d4981330ff5e for instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 on hv-cinder-85600 Sep 09 04:45:28.517305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-e4727d74-ad6d-4d42-a131-a25415c49d5d req-d04f8b6e-44b6-4d61-a026-5af0ab1367bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032324 Sep 09 04:45:28.518153 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 400/798] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:29.521346 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:29.522072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:29.529419 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:29.529983 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:29.530671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:29.531646 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:29.532180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:29.532707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:29.678369 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:29.692901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0d06c5b2-72a2-4048-bf65-6363a33e27ac tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1471 microversion: 2.1 time: 0.175490 Sep 09 04:45:29.694352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 399/799] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:29 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:30.660062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-2172797e-abc5-429d-a5a3-4944be9bc7e3 req-1dd098b6-a840-4492-85e4-7aa7e06e68a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b667ba59-f035-48d3-9294-15fa44cf50df", "name": "network-vif-deleted", "tag": "48ee6eb2-7391-492a-a7d8-e2d55e18c4fa"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:30.673157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-2172797e-abc5-429d-a5a3-4944be9bc7e3 req-1dd098b6-a840-4492-85e4-7aa7e06e68a0 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:30.673653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-2172797e-abc5-429d-a5a3-4944be9bc7e3 req-1dd098b6-a840-4492-85e4-7aa7e06e68a0 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:30.674472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-2172797e-abc5-429d-a5a3-4944be9bc7e3 req-1dd098b6-a840-4492-85e4-7aa7e06e68a0 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:30.687058 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-2172797e-abc5-429d-a5a3-4944be9bc7e3 req-1dd098b6-a840-4492-85e4-7aa7e06e68a0 service nova] Creating event network-vif-deleted:48ee6eb2-7391-492a-a7d8-e2d55e18c4fa for instance b667ba59-f035-48d3-9294-15fa44cf50df on hv-cinder-85600 Sep 09 04:45:30.692209 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-2172797e-abc5-429d-a5a3-4944be9bc7e3 req-1dd098b6-a840-4492-85e4-7aa7e06e68a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036008 Sep 09 04:45:30.697006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 401/800] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:30.719039 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:30.720343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:30.727023 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:30.727772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:30.728374 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:30.729247 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:30.729855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:30.730476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:30.801339 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c3d3df03944261acebdeac5d4154d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1461fc5c46f8433ebb5a9faa6d946b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:30.825985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f4385d4e-f158-46c8-b0cb-796ab4a5aa4c tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 200 len: 1300 microversion: 2.1 time: 0.110805 Sep 09 04:45:30.826606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 400/801] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:30 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:31.850984 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:31.851761 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] [instance: b667ba59-f035-48d3-9294-15fa44cf50df] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:31.858111 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:31.858663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:31.859302 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:31.860089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:31.860707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:31.861127 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:31.877735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] HTTP exception thrown: Instance b667ba59-f035-48d3-9294-15fa44cf50df could not be found. Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Request method failure captured: Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df HTTP/1.1 Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsTWjob6dMQCN7AZclWstq-jt1uOe9zS33zilMFFk65-Y1aYzQMDmIvsdnA9A82yKaeqtydgUZ3o8GNBGIaA0kwYRXwkx-wCT7WAO4VxYWcR9H5hbayP3mpiy628_GL9GMIL1OfMSeXwckK9xQAbM_64UB1nhjkmSX1bmz9Fo68pMBI Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 1461fc5c46f8433ebb5a9faa6d946b2f Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesNegativeTest-468268506 Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:45:31.879573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1461fc5c46f8433ebb5a9faa6d946b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1461fc5c46f8433ebb5a9faa6d946b2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1461fc5c46f8433ebb5a9faa6d946b2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1461fc5c46f8433ebb5a9faa6d946b2f"}]}] Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesNegativeTest-468268506 Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 1461fc5c46f8433ebb5a9faa6d946b2f Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesNegativeTest-468268506 Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesNegativeTest-468268506-project Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: c4c3d3df03944261acebdeac5d4154d7 Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesNegativeTest-468268506-project Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance b667ba59-f035-48d3-9294-15fa44cf50df could not be found. Sep 09 04:45:31.881321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'b667ba59-f035-48d3-9294-15fa44cf50df'} Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b667ba59-f035-48d3-9294-15fa44cf50df could not be found. Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:31.882334 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b667ba59-f035-48d3-9294-15fa44cf50df could not be found. Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b667ba59-f035-48d3-9294-15fa44cf50df could not be found. Sep 09 04:45:31.883920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:31.885323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] Returning 404 to user: Instance b667ba59-f035-48d3-9294-15fa44cf50df could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:31.885323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3d9ea432-cc52-4e0b-94cf-ab9281873c87 tempest-VolumesNegativeTest-468268506 tempest-VolumesNegativeTest-468268506-project] 10.222.0.20 "GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df" status: 404 len: 111 microversion: 2.1 time: 0.035315 Sep 09 04:45:31.885323 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 402/802] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:45:31 2022] GET /compute/v2.1/servers/b667ba59-f035-48d3-9294-15fa44cf50df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:45:45.247245 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:45.249584 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:45.252648 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:45.253555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=60 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:45.259240 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:45.259724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:45.260157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:45.260851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:45.261298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:45.261718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:45.294176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cef5b5de-cfcf-4f0c-a0bf-4b77a49531eb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050911 Sep 09 04:45:45.294737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 401/803] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Sep 9 04:45:45 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:45:45.362403 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:45.362953 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:45.365663 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:45.366311 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:45:45.372622 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:45.373608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:45.374031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:45.374727 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:45.376824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:45.376824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:45.405606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:45:45.482125 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-79b2941a-7e2e-4652-97e3-a374e85bda1b tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 204 len: 0 microversion: 2.20 time: 0.123253 Sep 09 04:45:45.482770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 403/804] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 04:45:45 2022] DELETE /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 04:45:45.491208 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:45.491810 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:45.500069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:45.500545 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:45.500973 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:45.501655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:45.502106 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:45.502554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:45.628528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:45.636547 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:45.637983 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:45.639762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3f680f07-26e4-456e-b70b-6f79cf455162 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.152493 Sep 09 04:45:45.640312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 402/805] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:45 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:46.666203 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:46.666897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:46.673807 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:46.674287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:46.674722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:46.675439 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:46.675889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:46.676313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:46.807769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:46.816804 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:46.818285 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:46.819484 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-48664e30-66f1-40d2-ae5e-5eb5837e44f2 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1724 microversion: 2.20 time: 0.157557 Sep 09 04:45:46.820083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 404/806] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:46 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:47.846425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:47.847057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:47.853096 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:47.853583 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:47.854023 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:47.854715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:47.855196 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:47.855623 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:47.917593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:47.927085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:47.928575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:47.929842 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-67421657-7311-49a3-8424-54b5dcb1ecbb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1656 microversion: 2.20 time: 0.087981 Sep 09 04:45:47.930439 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 403/807] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:47 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:48.197287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-3ba149f9-aa41-4361-8b7d-134e20615ac0 req-801e4583-3398-47a2-bf9b-ae4638cca9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88adb310-4be0-4b55-a3f9-65fe75a17959", "name": "network-vif-deleted", "tag": "ffb258f4-dc03-4824-b22c-0f1742f0ed65"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:45:48.209741 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3ba149f9-aa41-4361-8b7d-134e20615ac0 req-801e4583-3398-47a2-bf9b-ae4638cca9c0 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:48.210405 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3ba149f9-aa41-4361-8b7d-134e20615ac0 req-801e4583-3398-47a2-bf9b-ae4638cca9c0 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:48.210828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3ba149f9-aa41-4361-8b7d-134e20615ac0 req-801e4583-3398-47a2-bf9b-ae4638cca9c0 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:48.223313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-3ba149f9-aa41-4361-8b7d-134e20615ac0 req-801e4583-3398-47a2-bf9b-ae4638cca9c0 service nova] Creating event network-vif-deleted:ffb258f4-dc03-4824-b22c-0f1742f0ed65 for instance 88adb310-4be0-4b55-a3f9-65fe75a17959 on hv-cinder-85600 Sep 09 04:45:48.228774 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-3ba149f9-aa41-4361-8b7d-134e20615ac0 req-801e4583-3398-47a2-bf9b-ae4638cca9c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035118 Sep 09 04:45:48.229438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 405/808] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:45:48.956766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:48.957463 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:48.964048 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:48.964534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:48.964970 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:48.965670 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:48.966129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:48.967134 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:49.030233 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:49.038738 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:49.040222 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:49.041376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0e828ed1-bfde-43cc-95b8-328e91614894 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1656 microversion: 2.20 time: 0.088570 Sep 09 04:45:49.041927 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 404/809] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:48 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:50.067428 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:50.068129 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:50.074682 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:50.075193 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:50.075638 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:50.076333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:50.076782 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:50.077205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:50.137531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:50.145531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:50.146999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'befee01f638c4e7681b30c64acad6a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5176b458a4a8481eaa37d8693b51f15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:45:50.148128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2b613227-42f8-4130-b7bc-9cf52a475365 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 200 len: 1367 microversion: 2.20 time: 0.085268 Sep 09 04:45:50.148679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 406/810] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:50 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 04:45:51.174092 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:51.174699 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:51.183619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:51.184447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:51.184917 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:51.186451 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:51.186895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:51.187410 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:51.201174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] HTTP exception thrown: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Request method failure captured: Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 HTTP/1.1 Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNuan7TnuH7wGoBX7V6FPvGY8kbR7Jg1f6C2ofK76870JAeqqAEWFv8D1iZtkA_QsXhSPercQjuioLJc2tovFRM1hDwQ1cHXrioEiuU9uXG_ZpK5UJBlIBvwYr2vgRDtgr3wBEbgIgZphSVaXGfTLlW1nvNmZX1o3Cyt7OjzEzMJaA Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:45:51.202800 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}] Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: befee01f638c4e7681b30c64acad6a6a Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:51.204456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '88adb310-4be0-4b55-a3f9-65fe75a17959'} Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:51.205262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:51.206455 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:51.207573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Returning 404 to user: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:51.207573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d86ae119-d961-427f-abe0-c9bacf416edb tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 404 len: 111 microversion: 2.20 time: 0.034524 Sep 09 04:45:51.207573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 405/811] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:51 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:45:51.213329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9bbd9af7-4182-4f3b-a0b2-acaef6efbfc1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '.version_select at 0x7f43fab95c10>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:51.231712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9bbd9af7-4182-4f3b-a0b2-acaef6efbfc1 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778018958" status: 204 len: 0 microversion: 2.20 time: 0.022193 Sep 09 04:45:51.235788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 407/812] 10.222.0.20 () {60 vars in 1262 bytes} [Fri Sep 9 04:45:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778018958 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 04:45:52.993234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:52.993856 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:53.000529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:53.001183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:53.001612 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:53.002298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:53.002743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:53.003200 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:53.023086 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] HTTP exception thrown: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Request method failure captured: Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: DELETE /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 HTTP/1.1 Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNuan7TnuH7wGoBX7V6FPvGY8kbR7Jg1f6C2ofK76870JAeqqAEWFv8D1iZtkA_QsXhSPercQjuioLJc2tovFRM1hDwQ1cHXrioEiuU9uXG_ZpK5UJBlIBvwYr2vgRDtgr3wBEbgIgZphSVaXGfTLlW1nvNmZX1o3Cyt7OjzEzMJaA Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:45:53.024655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}] Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: befee01f638c4e7681b30c64acad6a6a Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.026261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '88adb310-4be0-4b55-a3f9-65fe75a17959'} Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:53.027255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.028797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.030545 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Returning 404 to user: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:53.030545 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5ff0ea37-8991-4f6d-82f5-5c7f4d54e836 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 404 len: 111 microversion: 2.20 time: 0.036771 Sep 09 04:45:53.030545 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 406/813] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 04:45:52 2022] DELETE /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:45:53.034868 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:53.035498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 88adb310-4be0-4b55-a3f9-65fe75a17959] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:53.042310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:53.042791 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:53.043253 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:53.043937 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:53.044386 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:53.044816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:53.058087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] HTTP exception thrown: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Request method failure captured: Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 HTTP/1.1 Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNuan7TnuH7wGoBX7V6FPvGY8kbR7Jg1f6C2ofK76870JAeqqAEWFv8D1iZtkA_QsXhSPercQjuioLJc2tovFRM1hDwQ1cHXrioEiuU9uXG_ZpK5UJBlIBvwYr2vgRDtgr3wBEbgIgZphSVaXGfTLlW1nvNmZX1o3Cyt7OjzEzMJaA Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:45:53.060395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}] Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: befee01f638c4e7681b30c64acad6a6a Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.061902 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '88adb310-4be0-4b55-a3f9-65fe75a17959'} Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:53.062790 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. Sep 09 04:45:53.064551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:53.066407 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Returning 404 to user: Instance 88adb310-4be0-4b55-a3f9-65fe75a17959 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:53.066407 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7dd5806d-6333-4adb-be3a-d1e21bb49e14 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959" status: 404 len: 111 microversion: 2.20 time: 0.030705 Sep 09 04:45:53.066407 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 408/814] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:53 2022] GET /compute/v2.1/servers/88adb310-4be0-4b55-a3f9-65fe75a17959 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:45:57.368294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:57.368782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:57.376043 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:57.376525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:57.376959 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:57.377648 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:57.378095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:57.378511 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:57.393720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] HTTP exception thrown: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Request method failure captured: Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: DELETE /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e HTTP/1.1 Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsNuan7TnuH7wGoBX7V6FPvGY8kbR7Jg1f6C2ofK76870JAeqqAEWFv8D1iZtkA_QsXhSPercQjuioLJc2tovFRM1hDwQ1cHXrioEiuU9uXG_ZpK5UJBlIBvwYr2vgRDtgr3wBEbgIgZphSVaXGfTLlW1nvNmZX1o3Cyt7OjzEzMJaA Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:45:57.393925 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}] Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: befee01f638c4e7681b30c64acad6a6a Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.395632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e'} Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:57.396458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.397883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.399340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Returning 404 to user: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:57.399340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8a991141-925f-49ac-a13a-fb2c2a2edd30 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 404 len: 111 microversion: 2.20 time: 0.030952 Sep 09 04:45:57.399340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 407/815] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Sep 9 04:45:57 2022] DELETE /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:45:57.404788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:45:57.405423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] [instance: 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:45:57.412240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:57.412719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:57.413150 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:57.413837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:45:57.414284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:45:57.414705 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:45:57.429071 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] HTTP exception thrown: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Request method failure captured: Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e HTTP/1.1 Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsNuan7TnuH7wGoBX7V6FPvGY8kbR7Jg1f6C2ofK76870JAeqqAEWFv8D1iZtkA_QsXhSPercQjuioLJc2tovFRM1hDwQ1cHXrioEiuU9uXG_ZpK5UJBlIBvwYr2vgRDtgr3wBEbgIgZphSVaXGfTLlW1nvNmZX1o3Cyt7OjzEzMJaA Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:45:57.430606 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5176b458a4a8481eaa37d8693b51f15e"}]}] Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 5176b458a4a8481eaa37d8693b51f15e Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916362447 Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: befee01f638c4e7681b30c64acad6a6a Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916362447-project Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.432295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e'} Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:45:57.433206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. Sep 09 04:45:57.434636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:45:57.436108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] Returning 404 to user: Instance 4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:45:57.436108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-32360e29-f1cc-4133-932e-e19327fe7109 tempest-AttachVolumeShelveTestJSON-1916362447 tempest-AttachVolumeShelveTestJSON-1916362447-project] 10.222.0.20 "GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e" status: 404 len: 111 microversion: 2.20 time: 0.031688 Sep 09 04:45:57.436108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 409/816] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Sep 9 04:45:57 2022] GET /compute/v2.1/servers/4ebb37da-ff78-4e93-b7a4-0d89b7bc5e3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 04:46:12.059589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=14 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:12.060296 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=30 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:12.231909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:12.233263 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:12.239669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:12.240476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:12.241135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:12.242150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:12.242709 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:12.243226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:12.268608 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-acb680f1-f219-4676-875b-af560a47e392 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/ips" status: 200 len: 151 microversion: 2.1 time: 0.213891 Sep 09 04:46:12.269182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 408/817] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:46:12 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/ips => generated 151 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:13.627016 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a1cc568-040a-4551-af96-22b18dee339a"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:46:13.629319 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:13.631794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:13.632460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:13.639158 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:13.639640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:13.640076 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:13.640769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:13.641235 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:13.641644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:13.953741 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-100366dd-b574-4def-8db3-4a1125fd9c51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "POST /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330580 Sep 09 04:46:13.959020 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 410/818] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:46:13 2022] POST /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:21.638116 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:21.639363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:21.645254 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:21.645729 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:21.646171 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:21.646860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:21.647340 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:21.647760 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:21.749519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'services' on Instance uuid 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:46:21.827983 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-67e9525d-3054-44b1-8e16-f22896fc9bb0 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments/7a1cc568-040a-4551-af96-22b18dee339a" status: 202 len: 0 microversion: 2.1 time: 0.193769 Sep 09 04:46:21.828594 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 409/819] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:46:21 2022] DELETE /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments/7a1cc568-040a-4551-af96-22b18dee339a => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:46:21.840931 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:21.844802 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:21.856295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:21.857748 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:21.858411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:21.859449 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:21.860052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:21.860558 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:21.896815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a6348dbe-4089-4fa6-981e-abb11987959c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062560 Sep 09 04:46:21.897592 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 411/820] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:46:21 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:22.910352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:22.912748 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:22.920157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:22.920649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:22.921083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:22.921806 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:22.922259 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:22.922689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:22.955629 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-381ac969-57ac-44a7-8aa0-8d4b031fc5e6 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050242 Sep 09 04:46:22.956235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 410/821] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:46:22 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 04:46:23.023002 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:23.023721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:23.030176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:23.030667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:23.031147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:23.031879 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:23.032336 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:23.032762 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:23.057523 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:46:23.133677 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5f908485-3757-45c3-85be-8ad5674bc322 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 204 len: 0 microversion: 2.1 time: 0.114482 Sep 09 04:46:23.134263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 412/822] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:46:23 2022] DELETE /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:46:23.143693 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:23.144631 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:23.152265 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:23.152829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:23.153323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:23.154703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:23.155233 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:23.156030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:23.291907 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:46:23.300162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7ac84a67-9251-4797-ba2a-e864fa4fe07d tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1683 microversion: 2.1 time: 0.161710 Sep 09 04:46:23.300741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 411/823] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:23 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:46:24.324194 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:24.324894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:24.331908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:24.332386 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:24.332819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:24.333501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:24.333943 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:24.334361 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:24.463777 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:46:24.472160 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ec21b307-ce10-4ec5-8765-016963b22d65 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1683 microversion: 2.1 time: 0.152246 Sep 09 04:46:24.472725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 413/824] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:24 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:46:25.495600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:25.496298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:25.503769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:25.504369 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:25.504884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:25.505715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:25.506276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:25.506804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:25.641707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:46:25.649415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f46a5f12-5c77-4041-8bcb-48fde6fd2a5c tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1683 microversion: 2.1 time: 0.158091 Sep 09 04:46:25.649979 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 412/825] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:25 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:46:26.033375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-83de8d39-2de2-4d0e-8a18-17c7b076d48b req-75188513-668a-4aef-9aff-f1ca7311a7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da0d58c-a9aa-4b45-b128-4bc6d684f7d8", "name": "network-vif-deleted", "tag": "19a6f675-87b2-4f03-b050-d4981330ff5e"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:46:26.043752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-83de8d39-2de2-4d0e-8a18-17c7b076d48b req-75188513-668a-4aef-9aff-f1ca7311a7de service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:26.044234 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-83de8d39-2de2-4d0e-8a18-17c7b076d48b req-75188513-668a-4aef-9aff-f1ca7311a7de service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:26.044666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-83de8d39-2de2-4d0e-8a18-17c7b076d48b req-75188513-668a-4aef-9aff-f1ca7311a7de service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:26.056665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-83de8d39-2de2-4d0e-8a18-17c7b076d48b req-75188513-668a-4aef-9aff-f1ca7311a7de service nova] Creating event network-vif-deleted:19a6f675-87b2-4f03-b050-d4981330ff5e for instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 on hv-cinder-85600 Sep 09 04:46:26.061873 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-83de8d39-2de2-4d0e-8a18-17c7b076d48b req-75188513-668a-4aef-9aff-f1ca7311a7de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 Sep 09 04:46:26.065984 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 414/826] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:26.674553 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:26.675232 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:26.684472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:26.685299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:26.685951 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:26.686785 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:26.687955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:26.689239 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:26.728448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:26.728942 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:26.729379 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:26.730013 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lazy-loading 'fault' on Instance uuid 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:46:26.773144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decd678421e4231bb3b58cd57d600bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bb02023bea4020ba1066ba4c85ff4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:46:26.786570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-491b87f0-6a8d-49c2-b575-e2e5466f8785 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 200 len: 1332 microversion: 2.1 time: 0.116046 Sep 09 04:46:26.787797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 413/827] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:26 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:46:27.810410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:27.811168 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:27.818352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:27.818894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:27.819316 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:27.820095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:27.820594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:27.821350 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:27.835304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 HTTP/1.1 Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:46:27.836912 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:27.838576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '6da0d58c-a9aa-4b45-b128-4bc6d684f7d8'} Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:27.839749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:27.841267 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:27.842448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:27.842448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2595ade2-521b-48ae-bb0a-66e6632d8afd tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 404 len: 111 microversion: 2.1 time: 0.032495 Sep 09 04:46:27.842448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 415/828] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:27 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:27.848843 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e45c8228-00fe-47b3-bff9-077c4997e689 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '.version_select at 0x7f43fabb21f0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:27.868669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e45c8228-00fe-47b3-bff9-077c4997e689 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552536664" status: 202 len: 0 microversion: 2.1 time: 0.024762 Sep 09 04:46:27.869427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 414/829] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Sep 9 04:46:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552536664 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:46:29.666660 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:29.667437 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:29.674152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:29.674629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:29.675095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:29.675779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:29.676225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:29.676644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:29.691061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 HTTP/1.1 Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:46:29.692863 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.694431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '6da0d58c-a9aa-4b45-b128-4bc6d684f7d8'} Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:29.695326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.696585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.698052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:29.698052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fed93a1d-b42d-48f3-841b-bc273d26ba51 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 404 len: 111 microversion: 2.1 time: 0.031984 Sep 09 04:46:29.698052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 416/830] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:46:29 2022] DELETE /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:29.704151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:29.705384 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:29.712075 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:29.712469 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:29.713247 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:29.714489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:29.715327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:29.716084 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:29.735850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 HTTP/1.1 Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:46:29.737506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.740307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '6da0d58c-a9aa-4b45-b128-4bc6d684f7d8'} Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:29.741206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. Sep 09 04:46:29.743626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:29.745540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:29.745540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e0209558-b04c-4ce7-8577-1d53725b86dc tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8" status: 404 len: 111 microversion: 2.1 time: 0.039634 Sep 09 04:46:29.745540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 415/831] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:29 2022] GET /compute/v2.1/servers/6da0d58c-a9aa-4b45-b128-4bc6d684f7d8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:30.886501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:30.887142 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:30.894425 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:30.895022 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:30.895533 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:30.896306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:30.896830 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:30.897338 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:30.913752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a HTTP/1.1 Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:46:30.915493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.917035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'f332a8b8-4ec7-43ee-b027-ee59bbd0763a'} Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:30.917824 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.919202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.920489 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:30.920489 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7a12fdd4-7e67-4add-b7de-3fa64684c8a5 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 404 len: 111 microversion: 2.1 time: 0.034400 Sep 09 04:46:30.920489 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 417/832] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:46:30 2022] DELETE /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:30.925532 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:30.926134 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: f332a8b8-4ec7-43ee-b027-ee59bbd0763a] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:30.932487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:30.932965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:30.933395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:30.934081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:30.934527 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:30.934999 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:30.948626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a HTTP/1.1 Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:46:30.950175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.951946 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'f332a8b8-4ec7-43ee-b027-ee59bbd0763a'} Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:30.952750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. Sep 09 04:46:30.954011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.956876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance f332a8b8-4ec7-43ee-b027-ee59bbd0763a could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:30.956876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-811b0c0d-796e-4b28-80f0-453fc471b1e4 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a" status: 404 len: 111 microversion: 2.1 time: 0.029950 Sep 09 04:46:30.956876 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 416/833] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:30 2022] GET /compute/v2.1/servers/f332a8b8-4ec7-43ee-b027-ee59bbd0763a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:30.964477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:30.965252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:30.972431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:30.973023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:30.973618 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:30.974640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:30.975197 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:30.976181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:30.991452 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 HTTP/1.1 Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:46:30.993106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:30.994686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '4491bf38-2476-4d98-81a8-4d82393cc599'} Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:30.995805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:30.997783 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:30.999599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:30.999599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e4986593-1c39-4c24-96b0-52f6c6dfaf0a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 404 len: 111 microversion: 2.1 time: 0.035367 Sep 09 04:46:30.999599 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 418/834] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:46:30 2022] DELETE /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:31.005574 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:31.006677 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 4491bf38-2476-4d98-81a8-4d82393cc599] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:31.014592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:31.015441 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:31.016069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:31.017432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:31.018327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:31.019036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:31.036065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 HTTP/1.1 Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:46:31.037779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:31.039486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '4491bf38-2476-4d98-81a8-4d82393cc599'} Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:31.040283 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. Sep 09 04:46:31.041832 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:31.043221 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 4491bf38-2476-4d98-81a8-4d82393cc599 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:31.043221 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0a22b50a-78c3-4e5d-aa21-16bc77e7bd1a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599" status: 404 len: 111 microversion: 2.1 time: 0.037940 Sep 09 04:46:31.043221 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 417/835] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:31 2022] GET /compute/v2.1/servers/4491bf38-2476-4d98-81a8-4d82393cc599 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:32.190828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:32.191358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:32.197904 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:32.198388 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:32.198830 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:32.199546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:32.200000 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:32.200427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:32.213998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 HTTP/1.1 Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:46:32.215540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.217146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '78e092d2-0c03-4288-be1b-f0f2da7f5de2'} Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:32.218023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.219477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.221485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:32.221485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-296e609d-db2c-4186-ad37-c67165ead77a tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 404 len: 111 microversion: 2.1 time: 0.029899 Sep 09 04:46:32.221485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 419/836] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:46:32 2022] DELETE /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:32.225922 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:32.226532 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] [instance: 78e092d2-0c03-4288-be1b-f0f2da7f5de2] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:46:32.232904 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:32.233383 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:32.233846 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:32.234530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:46:32.235000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:46:32.235423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:46:32.248610 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] HTTP exception thrown: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Request method failure captured: Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 HTTP/1.1 Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsPEg1pVMQjc3htg1ADsVn84d1fGjclKbhqV9ztH54vUxgOcNWreWgmaBjqGlk87Duw0OEWBsqP2-c-FZqN-rGQFq2HU9dlXwvyPC7G6RoVw0XxZOjhK1mjC850UjvFUIFyRsxkeD4c40D9jDSihXuf4Fo-5QM-WV4DiUgbnbB50ZFo Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:46:32.250093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/91bb02023bea4020ba1066ba4c85ff4d"}]}] Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 91bb02023bea4020ba1066ba4c85ff4d Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170244970 Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2decd678421e4231bb3b58cd57d600bc Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-AttachVolumeNegativeTest-1170244970-project Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.251779 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '78e092d2-0c03-4288-be1b-f0f2da7f5de2'} Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:32.252593 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. Sep 09 04:46:32.254036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:32.255366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] Returning 404 to user: Instance 78e092d2-0c03-4288-be1b-f0f2da7f5de2 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:32.255366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5d38d37f-d12f-4b5e-886a-efbc7d49b2e3 tempest-AttachVolumeNegativeTest-1170244970 tempest-AttachVolumeNegativeTest-1170244970-project] 10.222.0.20 "GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2" status: 404 len: 111 microversion: 2.1 time: 0.029397 Sep 09 04:46:32.255366 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 418/837] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:46:32 2022] GET /compute/v2.1/servers/78e092d2-0c03-4288-be1b-f0f2da7f5de2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 04:46:36.681927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b13522be-fd89-4615-a378-eafb95a1cb3b tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Action: 'create', calling method: .version_select at 0x7f43fab36550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1440437654"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:46:36.966065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b13522be-fd89-4615-a378-eafb95a1cb3b tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.398233 Sep 09 04:46:36.967140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 420/838] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Sep 9 04:46:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 04:46:36.980716 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f4f25a10-c7d1-4a07-9500-aabea42beac5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fac42790>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:37.034544 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f4f25a10-c7d1-4a07-9500-aabea42beac5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842" status: 200 len: 345 microversion: 2.1 time: 0.057676 Sep 09 04:46:37.035173 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 419/839] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:46:36 2022] GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:38.050159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f200523e-8562-407b-8f77-52437e13698c tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fab39790>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:38.103744 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f200523e-8562-407b-8f77-52437e13698c tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842" status: 200 len: 346 microversion: 2.1 time: 0.058473 Sep 09 04:46:38.104325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 421/840] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:46:38 2022] GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:46:38.119166 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1a8144de-247f-43d9-a2c5-86fa8ddc15b6 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Action: 'create', calling method: .version_select at 0x7f43fabb24c0>, body: {"snapshot": {"volume_id": "54052635-610b-493b-9178-22f37709f842", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1856200419"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:46:38.310454 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1a8144de-247f-43d9-a2c5-86fa8ddc15b6 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.195787 Sep 09 04:46:38.311244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 420/841] 10.222.0.20 () {60 vars in 1162 bytes} [Fri Sep 9 04:46:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:38.322853 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-406d2cac-057b-4e5c-ad96-60072991dcae tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fab95670>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:38.356078 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-406d2cac-057b-4e5c-ad96-60072991dcae tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 200 len: 287 microversion: 2.1 time: 0.037424 Sep 09 04:46:38.356774 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 422/842] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 04:46:38 2022] GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:38.368010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-30e9aa0b-720e-4e73-ab03-9f360750b334 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fac42e50>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:38.399878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-30e9aa0b-720e-4e73-ab03-9f360750b334 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035594 Sep 09 04:46:38.400451 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 421/843] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Sep 9 04:46:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:38.412023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c458da74-bc23-4939-8378-5fe1dfd430b5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fadfc790>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:38.441675 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c458da74-bc23-4939-8378-5fe1dfd430b5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 200 len: 287 microversion: 2.1 time: 0.033683 Sep 09 04:46:38.442258 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 423/844] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 04:46:38 2022] GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:39.456342 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-114baa66-34de-4c10-9639-30d56bf1adbf tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fabc4550>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:39.498451 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-114baa66-34de-4c10-9639-30d56bf1adbf tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 200 len: 287 microversion: 2.1 time: 0.047451 Sep 09 04:46:39.499046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 422/845] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 04:46:39 2022] GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:40.511455 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4b82722d-86da-4e10-8519-23a98ae1f68f tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fac13ca0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:40.541566 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4b82722d-86da-4e10-8519-23a98ae1f68f tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 200 len: 287 microversion: 2.1 time: 0.034369 Sep 09 04:46:40.542140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 424/846] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 04:46:40 2022] GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:41.554678 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a9c0aa3c-64fb-4e45-86c8-92db69934158 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fac06790>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:41.599379 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a9c0aa3c-64fb-4e45-86c8-92db69934158 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 200 len: 288 microversion: 2.1 time: 0.048442 Sep 09 04:46:41.600705 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 423/847] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 04:46:41 2022] GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 288 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:41.611578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ac2eca7a-5459-481a-8207-60b4fa7fd5f0 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fab29790>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:41.703130 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ac2eca7a-5459-481a-8207-60b4fa7fd5f0 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 202 len: 0 microversion: 2.1 time: 0.095181 Sep 09 04:46:41.707259 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 425/848] 10.222.0.20 () {58 vars in 1254 bytes} [Fri Sep 9 04:46:41 2022] DELETE /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:46:41.717557 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8c050401-111d-4df8-b7ae-80216ef6484b tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fabc4d30>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:41.761986 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8c050401-111d-4df8-b7ae-80216ef6484b tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 200 len: 287 microversion: 2.1 time: 0.052013 Sep 09 04:46:41.763957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 424/849] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 04:46:41 2022] GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:42.773705 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:42.776019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:42.790985 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09932cca-b4cd-4279-bc68-0eb7a28c0b51 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fab95dc0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:42.837475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-09932cca-b4cd-4279-bc68-0eb7a28c0b51 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] HTTP exception thrown: Snapshot b00a2c93-de72-4943-8aba-80444ed87ab9 could not be found. Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09932cca-b4cd-4279-bc68-0eb7a28c0b51 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Request method failure captured: Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 HTTP/1.1 Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsUssM7mMAZoLgJ_3QssY7wyaLY_CSgjK28__H9nmxAFFhWm-EFxsFKl6UvgQFaPgLO0xJzSYrdgNMvVklLRYwanU5Urm7jD0eoDpt6jWM-oOFo6itFtZ1uXETeljEcG3wdkHB2kcYtF5G8xehHaSEBWYwRdKlbASiIveBcSORRi460 Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:46:42.840670 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0546fa3da432440fa932e5dafced75a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}] Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: c5ad0cf3d7c141ecaaab277b748ea1e2 Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Snapshot b00a2c93-de72-4943-8aba-80444ed87ab9 could not be found. Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'b00a2c93-de72-4943-8aba-80444ed87ab9'} Sep 09 04:46:42.842099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b00a2c93-de72-4943-8aba-80444ed87ab9 could not be found. (HTTP 404) (Request-ID: req-c2bba2e1-cbbb-4216-85c7-21755135c2e1) Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:42.842983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:46:42.844308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b00a2c93-de72-4943-8aba-80444ed87ab9 could not be found. Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 04:46:42.846355 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b00a2c93-de72-4943-8aba-80444ed87ab9 could not be found. Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b00a2c93-de72-4943-8aba-80444ed87ab9 could not be found. Sep 09 04:46:42.848815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:42.851869 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-09932cca-b4cd-4279-bc68-0eb7a28c0b51 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Returning 404 to user: Snapshot b00a2c93-de72-4943-8aba-80444ed87ab9 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:42.853477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-09932cca-b4cd-4279-bc68-0eb7a28c0b51 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9" status: 404 len: 111 microversion: 2.1 time: 0.080899 Sep 09 04:46:42.854584 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 426/850] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Sep 9 04:46:42 2022] GET /compute/v2.1/os-snapshots/b00a2c93-de72-4943-8aba-80444ed87ab9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:42.859426 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:42.860255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:46:42.866138 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0408eede-cef6-42e5-a26e-fcdab8e139fb tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fac7c820>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:42.987526 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0408eede-cef6-42e5-a26e-fcdab8e139fb tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842" status: 202 len: 0 microversion: 2.1 time: 0.128647 Sep 09 04:46:42.988301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 425/851] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:46:42 2022] DELETE /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:46:42.998042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1a286f6a-2783-4fa1-bd07-9dbc0074421d tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fab29dc0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:43.057454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1a286f6a-2783-4fa1-bd07-9dbc0074421d tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842" status: 200 len: 345 microversion: 2.1 time: 0.063771 Sep 09 04:46:43.059035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 427/852] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:46:42 2022] GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:46:44.076024 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc3b754a-6015-4840-9e3e-36f4c9d84933 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fac42ee0>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:44.132100 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-fc3b754a-6015-4840-9e3e-36f4c9d84933 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] HTTP exception thrown: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc3b754a-6015-4840-9e3e-36f4c9d84933 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Request method failure captured: Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 HTTP/1.1 Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsUssM7mMAZoLgJ_3QssY7wyaLY_CSgjK28__H9nmxAFFhWm-EFxsFKl6UvgQFaPgLO0xJzSYrdgNMvVklLRYwanU5Urm7jD0eoDpt6jWM-oOFo6itFtZ1uXETeljEcG3wdkHB2kcYtF5G8xehHaSEBWYwRdKlbASiIveBcSORRi460 Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:46:44.134644 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0546fa3da432440fa932e5dafced75a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}] Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: c5ad0cf3d7c141ecaaab277b748ea1e2 Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '54052635-610b-493b-9178-22f37709f842'} Sep 09 04:46:44.136299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. (HTTP 404) (Request-ID: req-dd4d6c16-ce37-4ac9-a699-cb243e31bfae) Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.137137 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:46:44.138298 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 04:46:44.142352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.145939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.147598 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc3b754a-6015-4840-9e3e-36f4c9d84933 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Returning 404 to user: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:44.148796 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fc3b754a-6015-4840-9e3e-36f4c9d84933 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842" status: 404 len: 109 microversion: 2.1 time: 0.078231 Sep 09 04:46:44.149913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 426/853] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:46:44 2022] GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:44.164856 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-196e76cc-ba0b-45c9-b9f8-58dff60d84b5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fab95310>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:44.219220 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-196e76cc-ba0b-45c9-b9f8-58dff60d84b5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] HTTP exception thrown: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-196e76cc-ba0b-45c9-b9f8-58dff60d84b5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Request method failure captured: Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 HTTP/1.1 Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsUssM7mMAZoLgJ_3QssY7wyaLY_CSgjK28__H9nmxAFFhWm-EFxsFKl6UvgQFaPgLO0xJzSYrdgNMvVklLRYwanU5Urm7jD0eoDpt6jWM-oOFo6itFtZ1uXETeljEcG3wdkHB2kcYtF5G8xehHaSEBWYwRdKlbASiIveBcSORRi460 Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:46:44.222991 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0546fa3da432440fa932e5dafced75a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}] Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: c5ad0cf3d7c141ecaaab277b748ea1e2 Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': '54052635-610b-493b-9178-22f37709f842'} Sep 09 04:46:44.224343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. (HTTP 404) (Request-ID: req-b2926f14-3572-405d-bfce-9337ed6e83b7) Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.225173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 04:46:44.226374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 04:46:44.227583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.228839 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.232796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-196e76cc-ba0b-45c9-b9f8-58dff60d84b5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Returning 404 to user: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:44.233994 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-196e76cc-ba0b-45c9-b9f8-58dff60d84b5 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842" status: 404 len: 109 microversion: 2.1 time: 0.074014 Sep 09 04:46:44.234634 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 428/854] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Sep 9 04:46:44 2022] DELETE /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:44.243725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-186ae3ff-df5b-4585-9525-164995890ee0 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Calling method '.version_select at 0x7f43fac42f70>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:46:44.295737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-186ae3ff-df5b-4585-9525-164995890ee0 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] HTTP exception thrown: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-186ae3ff-df5b-4585-9525-164995890ee0 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Request method failure captured: Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 HTTP/1.1 Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsUssM7mMAZoLgJ_3QssY7wyaLY_CSgjK28__H9nmxAFFhWm-EFxsFKl6UvgQFaPgLO0xJzSYrdgNMvVklLRYwanU5Urm7jD0eoDpt6jWM-oOFo6itFtZ1uXETeljEcG3wdkHB2kcYtF5G8xehHaSEBWYwRdKlbASiIveBcSORRi460 Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:46:44.298031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0546fa3da432440fa932e5dafced75a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0546fa3da432440fa932e5dafced75a7"}]}] Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 0546fa3da432440fa932e5dafced75a7 Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790652420 Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: c5ad0cf3d7c141ecaaab277b748ea1e2 Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790652420-project Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '54052635-610b-493b-9178-22f37709f842'} Sep 09 04:46:44.299436 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. (HTTP 404) (Request-ID: req-2abff8e9-7c9f-4e20-acaf-70dd75f94fd1) Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.300255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 04:46:44.301389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 04:46:44.303290 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. Sep 09 04:46:44.304737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:46:44.310261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-186ae3ff-df5b-4585-9525-164995890ee0 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] Returning 404 to user: Volume 54052635-610b-493b-9178-22f37709f842 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:46:44.310261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-186ae3ff-df5b-4585-9525-164995890ee0 tempest-VolumesSnapshotsTestJSON-790652420 tempest-VolumesSnapshotsTestJSON-790652420-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842" status: 404 len: 109 microversion: 2.1 time: 0.070213 Sep 09 04:46:44.310261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 427/855] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Sep 9 04:46:44 2022] GET /compute/v2.1/os-volumes/54052635-610b-493b-9178-22f37709f842 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:46:55.300704 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a3888ae3-b310-4253-b72a-23363b05083b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Action: 'create', calling method: .version_select at 0x7f43fad168b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-488796557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/glMLzSh4IP8qXSi8zh1fHc3Ij3OzQo2VTidxNK5fIE0ldDrzgKmGX0zMdG0dxu0a6u6+AX5o0+g7g91cDLZWPhhktjgFSqqpppmAGr6s3AXokKuZwuIrivlcezrPKAw=="}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:46:55.318891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-a3888ae3-b310-4253-b72a-23363b05083b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for project ea4c285aae544f47a91407ff79414128. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:46:55.324404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-a3888ae3-b310-4253-b72a-23363b05083b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for user 9ece0d7befa845c0ab2a33bfb10b7850 and project ea4c285aae544f47a91407ff79414128. Resources: {'key_pairs'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:46:55.356237 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a3888ae3-b310-4253-b72a-23363b05083b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.314142 Sep 09 04:46:55.357480 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 429/856] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:46:55 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:08.658203 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-15b82807-708f-4ac6-8a23-5e935a7d61cc tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Action: 'create', calling method: .version_select at 0x7f43fabb2700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1635143123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVE2idsJKEzwvahcC9oJVloAklO+rSt+ZUAcWuTMJFXYOF42jo2u0KhFrMSdZcog5jVzlQi2tNbXDA6DxACvaDWHPAwaqaZu8Daqctv0ZEICO6Ns/GPvLlPQhyXkm08OQ=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:08.674232 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-15b82807-708f-4ac6-8a23-5e935a7d61cc tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Getting quotas for project 9931b1bca2464db7bcb90b91567cab28. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:47:08.678182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-15b82807-708f-4ac6-8a23-5e935a7d61cc tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Getting quotas for user c163b2e8db43490196e93b5fe4d45378 and project 9931b1bca2464db7bcb90b91567cab28. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:47:08.706533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-15b82807-708f-4ac6-8a23-5e935a7d61cc tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053996 Sep 09 04:47:08.707326 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 428/857] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:47:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:08.808543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=4 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:08.809286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:08.813726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1115829998", "imageRef": "a02ff1ad-bc22-4253-90ed-9fa5c21dc3d3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1635143123", "networks": [{"uuid": "538ad1e0-6b1a-4607-af36-c59973362ac1"}]}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:08.868574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] validate_networks() for [('538ad1e0-6b1a-4607-af36-c59973362ac1', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:47:09.278726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:47:09.279217 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:47:09.279789 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:47:09.280456 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:47:09.280927 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:47:09.290770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:09.291289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:09.291726 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:09.292464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:09.293256 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:09.293704 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:09.313145 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Getting quotas for project 9931b1bca2464db7bcb90b91567cab28. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:47:09.318615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Getting quotas for user c163b2e8db43490196e93b5fe4d45378 and project 9931b1bca2464db7bcb90b91567cab28. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:47:09.330658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:47:09.333045 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a02ff1ad-bc22-4253-90ed-9fa5c21dc3d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:47:09.380451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a89a33a2-f259-4645-bdb2-2e2f607e4cae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573101 Sep 09 04:47:09.387131 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 430/858] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:47:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:47:09.393057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fcdc06f1-a0d7-4a5e-972c-b5d839d8e3b9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:09.393872 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fcdc06f1-a0d7-4a5e-972c-b5d839d8e3b9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:09.475207 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fcdc06f1-a0d7-4a5e-972c-b5d839d8e3b9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:09.486569 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fcdc06f1-a0d7-4a5e-972c-b5d839d8e3b9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1259 microversion: 2.1 time: 0.097823 Sep 09 04:47:09.497708 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 429/859] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:09 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1259 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:10.510771 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:10.512073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:10.519866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:10.520400 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:10.520771 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:10.521958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:10.522132 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:10.522834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:10.598894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:10.609537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-289f9be0-af03-4991-a09e-c80d9e078e04 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1311 microversion: 2.1 time: 0.103713 Sep 09 04:47:10.610186 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 431/860] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:10 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:11.632509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:11.633178 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:11.642887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:11.647591 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:11.648214 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:11.648993 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:11.654692 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:11.655440 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:11.858304 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:11.868168 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f198b917-9ef7-4e88-b334-8eb96c1d9aad tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.238980 Sep 09 04:47:11.869331 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 430/861] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:11 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:12.297420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-211193a5-41f4-4bf9-9d9d-9870854010f5 req-c15a806e-3b27-4e53-8dc2-181d0b63bd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d0ca27-c29c-4997-90b3-0f50e0ce7af6", "tag": "715e0a6e-e934-4e7a-a87d-74f1376050a2"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:12.308263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-211193a5-41f4-4bf9-9d9d-9870854010f5 req-c15a806e-3b27-4e53-8dc2-181d0b63bd16 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:12.309069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-211193a5-41f4-4bf9-9d9d-9870854010f5 req-c15a806e-3b27-4e53-8dc2-181d0b63bd16 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:12.309789 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-211193a5-41f4-4bf9-9d9d-9870854010f5 req-c15a806e-3b27-4e53-8dc2-181d0b63bd16 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:12.334236 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-211193a5-41f4-4bf9-9d9d-9870854010f5 req-c15a806e-3b27-4e53-8dc2-181d0b63bd16 service nova] Creating event network-changed:715e0a6e-e934-4e7a-a87d-74f1376050a2 for instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 on hv-cinder-85600 Sep 09 04:47:12.340352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-211193a5-41f4-4bf9-9d9d-9870854010f5 req-c15a806e-3b27-4e53-8dc2-181d0b63bd16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047820 Sep 09 04:47:12.341436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 432/862] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:12.894301 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:12.894964 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:12.902669 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:12.903883 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:12.904422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:12.905253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:12.905816 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:12.907045 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:13.077481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:13.087597 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fe11ca77-d85c-4694-935e-424a4260345c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.197852 Sep 09 04:47:13.088166 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 431/863] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:12 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:14.044710 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1038466750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-488796557", "security_groups": [{"name": "tempest-secgroup-smoke-935715260"}], "block_device_mapping_v2": [{"uuid": "d214c94c-2c43-4dd1-bd91-b74316a8385b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8fb0b6b-bb8d-429d-b190-f0ae97f77f01"}]}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:14.112784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:14.113391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:14.120516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:14.121282 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:14.121882 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:14.122754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:14.123384 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:14.123962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:14.178199 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] validate_networks() for [('c8fb0b6b-bb8d-429d-b190-f0ae97f77f01', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:47:14.463025 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:14.478525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7d15a6df-8f1e-483a-b441-136bb0577473 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.369483 Sep 09 04:47:14.485067 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 432/864] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:14 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:14.798243 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:47:14.798730 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:47:14.799333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:47:14.799827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:47:14.800318 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:47:14.809786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:14.810489 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:14.811128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:14.812036 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:14.813205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:14.813915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:14.839819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for project ea4c285aae544f47a91407ff79414128. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:47:14.844933 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for user 9ece0d7befa845c0ab2a33bfb10b7850 and project ea4c285aae544f47a91407ff79414128. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:47:14.943181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:47:14.945740 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d214c94c-2c43-4dd1-bd91-b74316a8385b',volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:47:15.194509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-82913189-d4a8-4a43-990e-e5fbf2173cd7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.154459 Sep 09 04:47:15.197278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 433/865] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:47:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:47:15.209691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f09659b2-4a7e-411e-a0a0-224f9424975a tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:15.210316 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f09659b2-4a7e-411e-a0a0-224f9424975a tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:15.352042 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f09659b2-4a7e-411e-a0a0-224f9424975a tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:15.369944 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f09659b2-4a7e-411e-a0a0-224f9424975a tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1094 microversion: 2.1 time: 0.164384 Sep 09 04:47:15.370541 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 433/866] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:15 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1094 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:15.508841 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:15.510078 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:15.520261 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:15.521062 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:15.522051 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:15.525160 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:15.526448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:15.527239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:15.725551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:15.734835 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-350e967c-27d8-4b6a-b98f-2eac80cab8ae tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.232074 Sep 09 04:47:15.742647 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 434/867] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:15 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:16.400416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:16.401175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:16.411317 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:16.411989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:16.412622 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:16.413512 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:16.413971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:16.414412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:16.489616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:16.498830 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7abc5343-6158-47bc-9d2b-6c56c4f5cc6e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1144 microversion: 2.1 time: 0.102093 Sep 09 04:47:16.499509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 434/868] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:16 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1144 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:16.772242 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:16.773009 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:16.786253 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:16.786816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:16.787401 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:16.788120 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:16.788612 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:16.789076 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:16.986629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:16.995222 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-24823a14-8e5b-472d-8539-5c4229e86cf5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.227321 Sep 09 04:47:16.995798 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 435/869] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:16 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:17.526702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:17.527606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:17.534718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:17.535348 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:17.535792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:17.536507 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:17.536961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:17.537385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:17.606435 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:17.620550 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f6541183-e3df-4edc-b3c0-042ec4220058 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1144 microversion: 2.1 time: 0.098323 Sep 09 04:47:17.621234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 435/870] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:17 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:18.017862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:18.018575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:18.025422 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:18.025981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:18.026494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:18.027325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:18.027845 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:18.028383 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:18.181288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:18.189734 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b0eca249-4884-477e-83ff-053c7b347bd7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.175790 Sep 09 04:47:18.190313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 436/871] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:18 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:18.645199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:18.646623 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:18.653857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:18.654665 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:18.655408 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:18.657047 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:18.657896 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:18.658554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:18.741149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:18.749029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-89189d14-f14b-46a8-9fe0-a08611492259 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1144 microversion: 2.1 time: 0.108688 Sep 09 04:47:18.749809 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 436/872] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:18 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1144 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:18.953843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1945631554", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "networks": [{"uuid": "01239c8f-dc75-423a-ae26-b13a52578e3e"}]}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:19.006217 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] validate_networks() for [('01239c8f-dc75-423a-ae26-b13a52578e3e', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:47:19.213573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:19.214389 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:19.220658 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:19.221240 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:19.221753 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:19.222533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:19.223012 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:19.223439 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:19.423202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:47:19.423759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:47:19.424090 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:47:19.424497 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:47:19.424909 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:47:19.433621 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:19.434094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:19.434238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:19.434535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:19.435298 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:19.435752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:19.436174 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:19.442504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-51e28a20-b959-4cd4-8863-e95ee973758c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.232799 Sep 09 04:47:19.443110 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 437/873] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:19 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:19.454087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Getting quotas for project e40e149178c6430bac065ed46db7dbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:47:19.457767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Getting quotas for user 2703b4f1781e4f009d51f0929d6c555b and project e40e149178c6430bac065ed46db7dbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:47:19.468448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:47:19.470583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:47:19.515757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-aeb9e731-e431-4e40-b4de-929133847147 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566290 Sep 09 04:47:19.516393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 437/874] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:47:19.527571 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8d5cc75a-f666-4a55-980b-ff6fd605da11 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:19.528175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8d5cc75a-f666-4a55-980b-ff6fd605da11 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:19.585093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8d5cc75a-f666-4a55-980b-ff6fd605da11 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:19.591877 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8d5cc75a-f666-4a55-980b-ff6fd605da11 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1219 microversion: 2.1 time: 0.068119 Sep 09 04:47:19.592442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 438/875] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:19 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:19.771954 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:19.772600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:19.779546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:19.780146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:19.780655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:19.782011 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:19.782551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:19.783755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:19.852014 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:19.861630 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5c93141a-90f9-460f-bc85-f1a082b34709 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1144 microversion: 2.1 time: 0.093615 Sep 09 04:47:19.863281 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 438/876] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:19 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:20.465256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:20.465898 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:20.473417 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:20.473900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:20.474330 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:20.475270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:20.475726 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:20.476145 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:20.614512 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:20.615207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:20.629035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:20.631614 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:20.632260 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:20.633278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:20.633929 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:20.634072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:20.634740 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:20.646367 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-35b26f1c-446e-4835-a679-ac69d3d1e3c8 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.184873 Sep 09 04:47:20.664761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 439/877] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:20 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:20.708757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:20.717239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-caa47e9b-d176-423e-9d7b-4aa682aed00a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1271 microversion: 2.1 time: 0.107282 Sep 09 04:47:20.718053 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 439/878] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:20 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:20.884543 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:20.885177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:20.891689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:20.892146 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:20.892578 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:20.893268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:20.893717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:20.894136 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:20.955600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:20.963294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-ee455d42-f39f-46d8-abad-d37b79f80f88 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1210 microversion: 2.1 time: 0.082621 Sep 09 04:47:20.963982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 440/879] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:20 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:21.669588 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:21.671061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:21.678767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:21.679472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:21.679742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:21.680452 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:21.680906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:21.681329 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:21.740096 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:21.740659 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:21.747422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:21.747911 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:21.748349 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:21.749056 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:21.749509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:21.749971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:21.824062 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:21.832456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-ed9f0d09-532f-40a1-929c-342fc0a44e8e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1279 microversion: 2.1 time: 0.096255 Sep 09 04:47:21.833029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 441/880] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:21 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:21.840105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:21.848451 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d000c61d-979a-4448-94c8-8a9935e2b7ef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.182710 Sep 09 04:47:21.848955 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 440/881] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:21 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:21.985738 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:21.986352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:21.992799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:21.993533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:21.993985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:21.994737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:21.995175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:21.995595 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:22.157449 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:22.167352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-76c7a8ff-69de-41ec-bbc9-8ced726f2eb2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1277 microversion: 2.1 time: 0.185381 Sep 09 04:47:22.168488 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 442/882] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:21 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:22.855659 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:22.856354 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:22.866230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:22.866669 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:22.867143 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:22.867903 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:22.868378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:22.868745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:22.872635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:22.874813 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:22.881467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:22.881954 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:22.882383 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:22.883105 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:22.883558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:22.884525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:22.936873 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:22.946968 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fb369f01-d7dd-4123-8c6e-c52934bc7303 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1277 microversion: 2.1 time: 0.095006 Sep 09 04:47:22.947737 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 441/883] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:22 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:23.034733 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:23.042725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-526100bf-d164-4750-8af0-8fae83ed1459 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.175500 Sep 09 04:47:23.043379 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 443/884] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:22 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:23.192444 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:23.193051 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:23.200207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:23.200749 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:23.201189 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:23.201948 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:23.202578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:23.203085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:23.223403 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-2d663096-ff1f-4fdc-8170-6b2558b73f35 req-915e42a0-3bb4-4589-94bd-5333f4d1885c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35f607e-1028-4a37-8027-e86b1a8a9875", "tag": "5deef0e3-2202-4301-8d8f-a3be3fc97d38"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:23.234623 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2d663096-ff1f-4fdc-8170-6b2558b73f35 req-915e42a0-3bb4-4589-94bd-5333f4d1885c service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:23.235284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2d663096-ff1f-4fdc-8170-6b2558b73f35 req-915e42a0-3bb4-4589-94bd-5333f4d1885c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:23.235971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2d663096-ff1f-4fdc-8170-6b2558b73f35 req-915e42a0-3bb4-4589-94bd-5333f4d1885c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:23.248605 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-2d663096-ff1f-4fdc-8170-6b2558b73f35 req-915e42a0-3bb4-4589-94bd-5333f4d1885c service nova] Creating event network-changed:5deef0e3-2202-4301-8d8f-a3be3fc97d38 for instance c35f607e-1028-4a37-8027-e86b1a8a9875 on hv-cinder-85600 Sep 09 04:47:23.254920 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-2d663096-ff1f-4fdc-8170-6b2558b73f35 req-915e42a0-3bb4-4589-94bd-5333f4d1885c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036888 Sep 09 04:47:23.255718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 444/885] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:47:23.363423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:23.371681 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7a070842-ddbe-4e70-9b97-5f94d7cb8964 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.183283 Sep 09 04:47:23.372182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 442/886] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:23 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:23.972489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:23.973129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:23.979197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:23.979680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:23.980117 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:23.980813 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:23.981269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:23.981698 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:24.068512 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:24.069924 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:24.083344 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:24.084282 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:24.084942 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:24.086291 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:24.086998 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:24.087623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:24.280732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:24.295627 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-1e4e7695-ac80-496d-b264-8ec0a4283111 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1319 microversion: 2.1 time: 0.328451 Sep 09 04:47:24.307036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 445/887] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:23 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:24.308456 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:24.319372 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-83a0808f-5c96-4bf4-a23c-9a50dbac0fa9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.256447 Sep 09 04:47:24.320462 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 443/888] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:24 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:24.396162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:24.396863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:24.403437 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:24.404129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:24.404719 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:24.405594 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:24.406335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:24.406909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:24.557164 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:24.566065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b4cc35bc-1146-4034-bfaf-5da7141e1fb4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.173818 Sep 09 04:47:24.566938 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 446/889] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:24 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:25.275625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-84598e72-1ed3-41ff-a570-6ad6ab0cbde6 req-0e0bd982-fedf-446b-8af4-5baa93773e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b86af7-1cd5-4be6-8591-8642495eea42", "tag": "bae6b839-4691-4c7f-856d-11a052861e86"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:25.285799 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-84598e72-1ed3-41ff-a570-6ad6ab0cbde6 req-0e0bd982-fedf-446b-8af4-5baa93773e78 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:25.286275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-84598e72-1ed3-41ff-a570-6ad6ab0cbde6 req-0e0bd982-fedf-446b-8af4-5baa93773e78 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:25.286707 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-84598e72-1ed3-41ff-a570-6ad6ab0cbde6 req-0e0bd982-fedf-446b-8af4-5baa93773e78 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:25.298602 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-84598e72-1ed3-41ff-a570-6ad6ab0cbde6 req-0e0bd982-fedf-446b-8af4-5baa93773e78 service nova] Creating event network-changed:bae6b839-4691-4c7f-856d-11a052861e86 for instance f3b86af7-1cd5-4be6-8591-8642495eea42 on hv-cinder-85600 Sep 09 04:47:25.303727 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-84598e72-1ed3-41ff-a570-6ad6ab0cbde6 req-0e0bd982-fedf-446b-8af4-5baa93773e78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031802 Sep 09 04:47:25.304305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 444/890] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:25.318959 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:25.319576 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:25.325926 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:25.326404 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:25.326834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:25.327563 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:25.328034 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:25.328452 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:25.344310 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:25.345106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:25.351230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:25.351720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:25.352164 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:25.352891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:25.353349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:25.353779 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:25.527472 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:25.531648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:25.535722 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-762f5f30-c779-47a7-907d-60aea6350645 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1319 microversion: 2.1 time: 0.220808 Sep 09 04:47:25.536285 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 447/891] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:25 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:25.539945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bef432d5-20aa-4fdc-a62d-85d667ec7d21 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.200185 Sep 09 04:47:25.540509 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 445/892] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:25 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:25.589335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:25.590044 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:25.596502 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:25.596981 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:25.597411 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:25.598122 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:25.598570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:25.599017 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:25.728558 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:25.736249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8250f52f-edf3-4184-abec-5ecfe348b680 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.150686 Sep 09 04:47:25.736815 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 448/893] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:25 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:26.390220 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-7862a0cc-2450-4a20-a91a-806375350a17 req-07a648f1-f6ff-4c3d-ac87-af1f6567abac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d0ca27-c29c-4997-90b3-0f50e0ce7af6", "name": "network-vif-plugged", "status": "completed", "tag": "715e0a6e-e934-4e7a-a87d-74f1376050a2"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:26.400667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-7862a0cc-2450-4a20-a91a-806375350a17 req-07a648f1-f6ff-4c3d-ac87-af1f6567abac service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:26.401114 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-7862a0cc-2450-4a20-a91a-806375350a17 req-07a648f1-f6ff-4c3d-ac87-af1f6567abac service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:26.401620 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-7862a0cc-2450-4a20-a91a-806375350a17 req-07a648f1-f6ff-4c3d-ac87-af1f6567abac service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:26.413648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-7862a0cc-2450-4a20-a91a-806375350a17 req-07a648f1-f6ff-4c3d-ac87-af1f6567abac service nova] Creating event network-vif-plugged:715e0a6e-e934-4e7a-a87d-74f1376050a2 for instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 on hv-cinder-85600 Sep 09 04:47:26.418424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-7862a0cc-2450-4a20-a91a-806375350a17 req-07a648f1-f6ff-4c3d-ac87-af1f6567abac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031855 Sep 09 04:47:26.419253 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 446/894] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:26.560714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:26.563063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:26.563557 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:26.564558 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:26.571833 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:26.572429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:26.572629 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:26.572986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:26.573144 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:26.573585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:26.574116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:26.574294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:26.574691 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:26.574803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:26.575200 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:26.575422 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:26.579546 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:26.773636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:26.781843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3c66d20c-2ae0-42b2-b7d8-6bddec1eaef9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.223691 Sep 09 04:47:26.783132 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 447/895] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:26 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:26.785367 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:26.787873 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:26.789014 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:26.793520 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4f5ac4d1-75cf-40b1-a8a6-94015a72f749 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1319 microversion: 2.1 time: 0.239456 Sep 09 04:47:26.798992 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 449/896] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:26 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:26.799172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:26.799172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:26.799172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:26.799172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:26.799543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:26.799543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:26.928234 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:26.935964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-60e1dd7a-df3f-480d-9f9d-81ffae51534b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.151792 Sep 09 04:47:26.936538 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 448/897] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:26 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:27.805216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:27.805864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:27.812592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:27.813084 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:27.814104 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:27.814807 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:27.815289 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:27.815718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:27.817624 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:27.818239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:27.824537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:27.825021 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:27.825459 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:27.826152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:27.826603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:27.827042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:28.005909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:28.009894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:28.013785 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-46adfb11-c82c-4126-a246-5f23fdd12942 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1359 microversion: 2.1 time: 0.212420 Sep 09 04:47:28.014358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 450/898] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:27 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:28.017844 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d243ee92-3076-43a8-a89c-e53b12fbfc47 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1319 microversion: 2.1 time: 0.204895 Sep 09 04:47:28.018668 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 449/899] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:27 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:28.018789 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:28.019420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:28.025416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:28.025912 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:28.026381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:28.027125 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:28.027585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:28.028014 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:28.156499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:28.164561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8d6b7a66-1286-4b60-a968-519f42e1ff1f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.149273 Sep 09 04:47:28.165130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 451/900] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:28 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:29.036659 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:29.037232 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:29.039784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:29.040399 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:29.043752 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.044234 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.044668 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.045369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.045823 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.046248 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.046944 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.047440 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.047884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.048580 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.049047 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.049464 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.064265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=100 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:29.234922 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:29.239600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:29.243447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-193fe53d-9e43-468a-af4c-87d8a296ae59 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1548 microversion: 2.1 time: 0.210888 Sep 09 04:47:29.244023 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 450/901] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:29 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:29.247262 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2a1c6627-05aa-4e1b-a8e5-3d5c9fc4b037 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1319 microversion: 2.1 time: 0.211291 Sep 09 04:47:29.250477 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 452/902] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:29 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:29.250604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:29.250604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:29.255681 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.256180 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.256604 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.257297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.257748 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.258175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.268061 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:29.268663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:29.274542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.275058 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.275617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.276312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.276756 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.277174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.438152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:29.445211 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=6 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:29.448286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c5e89eeb-2cad-4afa-b14b-f165947c5300 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.203312 Sep 09 04:47:29.448857 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 451/903] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:29 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:29.459798 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:29.467509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-42ef1b4e-6589-41d0-9595-26a67e1ebfeb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1548 microversion: 2.1 time: 0.203465 Sep 09 04:47:29.468082 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 453/904] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:29 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:29.490586 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:29.495463 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:29.496225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Searching by: {'deleted': False, 'project_id': '9931b1bca2464db7bcb90b91567cab28'} {{(pid=127437) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 04:47:29.497961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=18 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:29.504461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.504938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.505375 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.506102 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.506555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.507006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.592658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.multi_cell_list [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127437) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 04:47:29.684842 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b4d35573-27c6-4fb1-942b-eccfa9ae6881 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198184 Sep 09 04:47:29.685426 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 452/905] 10.222.0.20 () {58 vars in 1125 bytes} [Fri Sep 9 04:47:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:29.697420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:29.698037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:29.699901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=10 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:29.705485 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.705968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.706403 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.707126 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:29.707577 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:29.708000 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:29.835605 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:29.843470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-73b6b88b-efc7-4893-a9fa-5b588296f2bf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1548 microversion: 2.1 time: 0.149971 Sep 09 04:47:29.844037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 454/906] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:29 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:30.272208 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:30.272834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:30.279275 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:30.279873 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:30.280320 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:30.281017 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:30.281471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:30.281900 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:30.433270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-10974f6f-f157-4e2d-b578-77b943c5ed8d req-c1755729-6bdd-46f4-8c1a-d5771ef00a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b86af7-1cd5-4be6-8591-8642495eea42", "name": "network-vif-plugged", "status": "completed", "tag": "bae6b839-4691-4c7f-856d-11a052861e86"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:30.446880 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-10974f6f-f157-4e2d-b578-77b943c5ed8d req-c1755729-6bdd-46f4-8c1a-d5771ef00a2a service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:30.447549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-10974f6f-f157-4e2d-b578-77b943c5ed8d req-c1755729-6bdd-46f4-8c1a-d5771ef00a2a service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:30.449540 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-10974f6f-f157-4e2d-b578-77b943c5ed8d req-c1755729-6bdd-46f4-8c1a-d5771ef00a2a service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:30.460396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-10974f6f-f157-4e2d-b578-77b943c5ed8d req-c1755729-6bdd-46f4-8c1a-d5771ef00a2a service nova] Creating event network-vif-plugged:bae6b839-4691-4c7f-856d-11a052861e86 for instance f3b86af7-1cd5-4be6-8591-8642495eea42 on hv-cinder-85600 Sep 09 04:47:30.465544 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-10974f6f-f157-4e2d-b578-77b943c5ed8d req-c1755729-6bdd-46f4-8c1a-d5771ef00a2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036000 Sep 09 04:47:30.466649 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 455/907] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:30.483489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:30.484214 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:30.491292 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:30.492023 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:30.492529 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:30.493227 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:30.493895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:30.494446 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:30.633992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:30.643889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-74214d7b-0be6-4809-a60d-eeae1cbf0a46 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1319 microversion: 2.1 time: 0.377599 Sep 09 04:47:30.644573 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 453/908] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:30 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:30.666165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:30.675754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-33218acf-80b3-4f7f-bacc-d72a14e01c58 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.207659 Sep 09 04:47:30.676260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 456/909] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:30 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:31.386751 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8b06dba-776e-4d56-95aa-5ec888ebeff2"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:31.389098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:31.397896 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:31.398374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:31.398804 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:31.399549 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:31.400001 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:31.400417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:31.666767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:31.667452 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:31.674884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:31.675919 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:31.676587 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:31.677304 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:31.677758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:31.678181 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:31.695704 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-06dc6af4-0a02-4d7f-9e10-59c8edb3ce79 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312666 Sep 09 04:47:31.696205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 454/910] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:47:31 2022] POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:31.701610 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:31.702517 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:31.709566 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:31.710059 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:31.710499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:31.711290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:31.711761 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:31.712177 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:32.149641 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:32.157701 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-481a3768-dbd4-420c-b91b-77522edc7005 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1319 microversion: 2.1 time: 0.495998 Sep 09 04:47:32.158367 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 457/911] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:31 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:32.171085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:32.171085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a9f1f923-a849-4ce3-989f-f5534224d4b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.471809 Sep 09 04:47:32.171085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 455/912] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:31 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:33.193309 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:33.193985 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:33.195011 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:33.195624 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:33.197490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:33.201815 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:33.202028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:33.202410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:33.202532 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:33.202858 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:33.202985 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:33.203589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:33.204193 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:33.204535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:33.204637 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:33.204963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:33.205072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:33.389227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:33.397536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-c82ea257-3c72-4c14-8496-8c6b26b57b22 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1508 microversion: 2.1 time: 0.208365 Sep 09 04:47:33.398221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 456/913] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:33 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:33.408277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:33.416530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b04c4ff4-4f60-4444-9d3d-6494c5ee6fe0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.225631 Sep 09 04:47:33.417097 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 458/914] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:33 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:47:34.439147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:34.439773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:34.446643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:34.447301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:34.447751 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:34.448463 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:34.448918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:34.449385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:34.450967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-4999e53e-5dc6-48cb-8e3a-7febda411fb3 req-f2c2dac5-e396-4596-9f36-c5bd5d972fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35f607e-1028-4a37-8027-e86b1a8a9875", "name": "network-vif-plugged", "status": "completed", "tag": "5deef0e3-2202-4301-8d8f-a3be3fc97d38"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:34.462108 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-4999e53e-5dc6-48cb-8e3a-7febda411fb3 req-f2c2dac5-e396-4596-9f36-c5bd5d972fe7 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:34.462834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-4999e53e-5dc6-48cb-8e3a-7febda411fb3 req-f2c2dac5-e396-4596-9f36-c5bd5d972fe7 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:34.463357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-4999e53e-5dc6-48cb-8e3a-7febda411fb3 req-f2c2dac5-e396-4596-9f36-c5bd5d972fe7 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:34.477622 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-4999e53e-5dc6-48cb-8e3a-7febda411fb3 req-f2c2dac5-e396-4596-9f36-c5bd5d972fe7 service nova] Creating event network-vif-plugged:5deef0e3-2202-4301-8d8f-a3be3fc97d38 for instance c35f607e-1028-4a37-8027-e86b1a8a9875 on hv-cinder-85600 Sep 09 04:47:34.482525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-4999e53e-5dc6-48cb-8e3a-7febda411fb3 req-f2c2dac5-e396-4596-9f36-c5bd5d972fe7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035689 Sep 09 04:47:34.483462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 459/915] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:47:34.588897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:34.597285 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a9a995ac-b0ee-4f99-be2d-dc7065c80f23 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.162252 Sep 09 04:47:34.597845 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 457/916] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:34 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:35.620914 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:35.621530 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:35.627657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:35.628146 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:35.628585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:35.629277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:35.629731 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:35.630158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:35.777896 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:35.786294 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e3e7e18e-bfb8-465a-ac76-27074ba83d43 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1265 microversion: 2.1 time: 0.170174 Sep 09 04:47:35.786866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 460/917] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:35 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:36.808852 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:36.809466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:36.816538 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:36.817644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:36.818087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:36.818780 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:36.819257 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:36.819685 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:36.951915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:36.960387 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8c6a2519-16af-4718-a0a6-fb9b68333d31 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1452 microversion: 2.1 time: 0.155331 Sep 09 04:47:36.975143 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 458/918] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:36 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:36.992334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:36.992944 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:36.999321 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:36.999804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:37.000236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:37.000923 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:37.001371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:37.001797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:37.133813 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:37.141505 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-dc0acc62-bec7-4d75-b82b-8f33779984d2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1452 microversion: 2.1 time: 0.153252 Sep 09 04:47:37.142064 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 461/919] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:36 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:38.870212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-6c60a61e-49f4-4c93-80f0-e66ce62dd0ce req-8857b95d-877a-4e85-ac53-91590be1cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c35f607e-1028-4a37-8027-e86b1a8a9875", "tag": "5deef0e3-2202-4301-8d8f-a3be3fc97d38"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:38.880564 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-6c60a61e-49f4-4c93-80f0-e66ce62dd0ce req-8857b95d-877a-4e85-ac53-91590be1cba2 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:38.880981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-6c60a61e-49f4-4c93-80f0-e66ce62dd0ce req-8857b95d-877a-4e85-ac53-91590be1cba2 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:38.881415 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-6c60a61e-49f4-4c93-80f0-e66ce62dd0ce req-8857b95d-877a-4e85-ac53-91590be1cba2 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:38.895250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-6c60a61e-49f4-4c93-80f0-e66ce62dd0ce req-8857b95d-877a-4e85-ac53-91590be1cba2 service nova] Creating event network-changed:5deef0e3-2202-4301-8d8f-a3be3fc97d38 for instance c35f607e-1028-4a37-8027-e86b1a8a9875 on hv-cinder-85600 Sep 09 04:47:38.900409 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-6c60a61e-49f4-4c93-80f0-e66ce62dd0ce req-8857b95d-877a-4e85-ac53-91590be1cba2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033729 Sep 09 04:47:38.901098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 459/920] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:39.327059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:39.327666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:39.332823 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:39.337357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:39.337847 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:39.338373 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:39.339370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:39.340210 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:39.340820 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:39.494898 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:39.504256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a913492c-9d45-4a44-8f9b-6adeca6112cf tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1594 microversion: 2.1 time: 0.180947 Sep 09 04:47:39.505251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 462/921] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:39 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1594 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:41.516688 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:47:41.521961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-8c6e8624-9d78-4722-b35f-505290c6b7e4 req-c51b68e9-cfee-4a5e-bfaa-edf9938b2d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d0ca27-c29c-4997-90b3-0f50e0ce7af6", "tag": "715e0a6e-e934-4e7a-a87d-74f1376050a2"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:41.532231 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-8c6e8624-9d78-4722-b35f-505290c6b7e4 req-c51b68e9-cfee-4a5e-bfaa-edf9938b2d36 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:41.532721 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-8c6e8624-9d78-4722-b35f-505290c6b7e4 req-c51b68e9-cfee-4a5e-bfaa-edf9938b2d36 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:41.533165 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-8c6e8624-9d78-4722-b35f-505290c6b7e4 req-c51b68e9-cfee-4a5e-bfaa-edf9938b2d36 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:41.545184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-8c6e8624-9d78-4722-b35f-505290c6b7e4 req-c51b68e9-cfee-4a5e-bfaa-edf9938b2d36 service nova] Creating event network-changed:715e0a6e-e934-4e7a-a87d-74f1376050a2 for instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 on hv-cinder-85600 Sep 09 04:47:41.550151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-8c6e8624-9d78-4722-b35f-505290c6b7e4 req-c51b68e9-cfee-4a5e-bfaa-edf9938b2d36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034289 Sep 09 04:47:41.550992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 460/922] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:47:42.600936 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-299727311"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:42.601499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:42.608406 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:42.609015 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:42.609507 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:42.610216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:42.610667 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:42.611352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:42.758794 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.network.security_group_api [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Adding security group 46d0b1af-8c96-4e04-9f6a-18b1cbaccfb5 to port 715e0a6e-e934-4e7a-a87d-74f1376050a2 Sep 09 04:47:43.076109 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-4331ce30-7628-4d12-84cd-03dee134a22a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/action" status: 202 len: 0 microversion: 2.1 time: 0.479692 Sep 09 04:47:43.076718 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 463/923] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:47:42 2022] POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:47:43.086545 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:47:43.087363 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:43.093618 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:43.094205 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:43.094715 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:43.095520 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:43.096052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:43.096568 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:43.250865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:47:43.259678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1c7638c6-d17e-4351-9543-3674224140ff tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1758 microversion: 2.1 time: 0.178459 Sep 09 04:47:43.260287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 461/924] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:47:43 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:47:43.565268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-c546c6ee-2e6b-4607-a752-d19fa60fafe7 req-39a0a5e5-7ed8-4ccd-9dee-06dc5762823f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d0ca27-c29c-4997-90b3-0f50e0ce7af6", "tag": "715e0a6e-e934-4e7a-a87d-74f1376050a2"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:43.578840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-c546c6ee-2e6b-4607-a752-d19fa60fafe7 req-39a0a5e5-7ed8-4ccd-9dee-06dc5762823f service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:43.579348 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-c546c6ee-2e6b-4607-a752-d19fa60fafe7 req-39a0a5e5-7ed8-4ccd-9dee-06dc5762823f service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:43.579801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-c546c6ee-2e6b-4607-a752-d19fa60fafe7 req-39a0a5e5-7ed8-4ccd-9dee-06dc5762823f service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:43.590902 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-c546c6ee-2e6b-4607-a752-d19fa60fafe7 req-39a0a5e5-7ed8-4ccd-9dee-06dc5762823f service nova] Creating event network-changed:715e0a6e-e934-4e7a-a87d-74f1376050a2 for instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 on hv-cinder-85600 Sep 09 04:47:43.596095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-c546c6ee-2e6b-4607-a752-d19fa60fafe7 req-39a0a5e5-7ed8-4ccd-9dee-06dc5762823f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034873 Sep 09 04:47:43.597020 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 464/925] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:47:48.634702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45724acc-d654-4b1f-ab38-09cb1f59a456", "device": "/dev/sdb"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:47:48.637513 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:47:48.644124 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:48.644600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:48.645035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:48.648113 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:47:48.648574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:47:48.649005 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:47:48.904995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a323bde4-fdab-4777-a1d6-d5e7794ab338 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "POST /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274014 Sep 09 04:47:48.905722 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 462/926] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:47:48 2022] POST /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:48:12.594460 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:12.595069 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:12.597509 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=5 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:12.598190 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=80 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:12.604111 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:12.604592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:12.605025 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:12.605710 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:12.606160 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:12.606581 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:12.687155 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lazy-loading 'services' on Instance uuid f3b86af7-1cd5-4be6-8591-8642495eea42 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:48:12.760199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-620b43d5-2dee-4fae-8daf-de79b69f731a tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42/os-volume_attachments/45724acc-d654-4b1f-ab38-09cb1f59a456" status: 202 len: 0 microversion: 2.1 time: 0.169813 Sep 09 04:48:12.760792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 465/927] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:48:12 2022] DELETE /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42/os-volume_attachments/45724acc-d654-4b1f-ab38-09cb1f59a456 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:48:13.878819 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=12 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:13.880110 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:13.884665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:13.885236 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:13.892934 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:13.893420 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:13.893855 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:13.894549 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:13.895034 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:13.896088 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:13.921373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:48:13.994093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-328beee2-816d-4eeb-9f28-2d9c9fced948 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 204 len: 0 microversion: 2.1 time: 0.116745 Sep 09 04:48:13.994594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 463/928] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:48:13 2022] DELETE /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:48:14.003252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:14.003957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:14.011312 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:14.011788 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:14.012224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:14.012909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:14.013359 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:14.013790 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:14.144772 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:14.152456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6af1e147-d849-4393-9746-8257ba4d7456 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1514 microversion: 2.1 time: 0.153372 Sep 09 04:48:14.153016 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 466/929] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:13 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:15.175581 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:15.176309 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:15.182672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:15.183126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:15.183560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:15.184246 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:15.184696 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:15.185116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:15.313865 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:15.322024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5b6533fe-8332-4276-8e83-de3c5844d5e1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1514 microversion: 2.1 time: 0.150716 Sep 09 04:48:15.322591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 464/930] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:15 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:16.346738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-3917e883-723c-4398-a750-f83460501cf2 req-7c9e3d28-6319-4822-818a-1e35f120e34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b86af7-1cd5-4be6-8591-8642495eea42", "name": "network-vif-deleted", "tag": "bae6b839-4691-4c7f-856d-11a052861e86"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:48:16.347438 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:16.348012 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:16.356434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:16.356954 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:16.357391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:16.358798 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:16.359063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3917e883-723c-4398-a750-f83460501cf2 req-7c9e3d28-6319-4822-818a-1e35f120e34b service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:16.359318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:16.359548 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3917e883-723c-4398-a750-f83460501cf2 req-7c9e3d28-6319-4822-818a-1e35f120e34b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:16.359812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:16.359964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-3917e883-723c-4398-a750-f83460501cf2 req-7c9e3d28-6319-4822-818a-1e35f120e34b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:16.372478 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-3917e883-723c-4398-a750-f83460501cf2 req-7c9e3d28-6319-4822-818a-1e35f120e34b service nova] Creating event network-vif-deleted:bae6b839-4691-4c7f-856d-11a052861e86 for instance f3b86af7-1cd5-4be6-8591-8642495eea42 on hv-cinder-85600 Sep 09 04:48:16.377277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-3917e883-723c-4398-a750-f83460501cf2 req-7c9e3d28-6319-4822-818a-1e35f120e34b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034111 Sep 09 04:48:16.377859 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 465/931] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:48:16.426355 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:16.434236 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2ea6eab8-58c5-4ad5-b0d7-82bddae72cb9 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 200 len: 1472 microversion: 2.1 time: 0.092506 Sep 09 04:48:16.434820 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 467/932] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:16 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:17.458764 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:17.459471 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: f3b86af7-1cd5-4be6-8591-8642495eea42] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:17.465655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:17.466140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:17.466578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:17.467333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:17.467786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:17.468219 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:17.484063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] HTTP exception thrown: Instance f3b86af7-1cd5-4be6-8591-8642495eea42 could not be found. Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Request method failure captured: Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 HTTP/1.1 Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsVV41446qHQwZSTCyC59F8em5WbFlWkOMcPkt0wuEYqnqKs4wYYubJxF1izeuvJwIAksR1Q_nfztz6xoiyFGjf8I7fjnzkyySflvlMYIEDoEBpaE9h2CMksF5ehG5_aCEmnswRKPNSdZ4wymsDg5RoJYcQzBK6IAqSTn5Pssjq08oc Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: e40e149178c6430bac065ed46db7dbf8 Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-VolumesSnapshotTestJSON-175283707 Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:48:17.485692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e40e149178c6430bac065ed46db7dbf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e40e149178c6430bac065ed46db7dbf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e40e149178c6430bac065ed46db7dbf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e40e149178c6430bac065ed46db7dbf8"}]}] Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-VolumesSnapshotTestJSON-175283707 Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: e40e149178c6430bac065ed46db7dbf8 Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-175283707 Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-VolumesSnapshotTestJSON-175283707-project Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 2703b4f1781e4f009d51f0929d6c555b Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-VolumesSnapshotTestJSON-175283707-project Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance f3b86af7-1cd5-4be6-8591-8642495eea42 could not be found. Sep 09 04:48:17.487495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'f3b86af7-1cd5-4be6-8591-8642495eea42'} Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b86af7-1cd5-4be6-8591-8642495eea42 could not be found. Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:48:17.488563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b86af7-1cd5-4be6-8591-8642495eea42 could not be found. Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b86af7-1cd5-4be6-8591-8642495eea42 could not be found. Sep 09 04:48:17.490738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:48:17.492198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Returning 404 to user: Instance f3b86af7-1cd5-4be6-8591-8642495eea42 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:48:17.492198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7bff5423-291e-446a-bdd0-8bf803e1dddd tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42" status: 404 len: 111 microversion: 2.1 time: 0.033067 Sep 09 04:48:17.492198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 466/933] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:17 2022] GET /compute/v2.1/servers/f3b86af7-1cd5-4be6-8591-8642495eea42 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:48:25.266397 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1587915224", "imageRef": "97fc9c5f-ee0a-455f-a5a8-096b774be38d", "flavorRef": "452", "networks": [{"uuid": "01239c8f-dc75-423a-ae26-b13a52578e3e"}]}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:48:25.319334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] validate_networks() for [('01239c8f-dc75-423a-ae26-b13a52578e3e', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:48:25.706481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:48:25.706917 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:48:25.708091 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:48:25.708511 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:48:25.708922 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:48:25.717596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:25.718073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:25.718525 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:25.719270 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:25.719724 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:25.720147 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:25.736499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Getting quotas for project e40e149178c6430bac065ed46db7dbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:48:25.740388 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Getting quotas for user 2703b4f1781e4f009d51f0929d6c555b and project e40e149178c6430bac065ed46db7dbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:48:25.751197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:48:25.753448 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97fc9c5f-ee0a-455f-a5a8-096b774be38d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:48:25.798382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-527b37a7-4207-42c0-93c4-614db177e4a6 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535740 Sep 09 04:48:25.799050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 468/934] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:48:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:48:25.810120 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7f0f1bfa-1d2a-4607-98de-273882591e67 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:25.810820 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7f0f1bfa-1d2a-4607-98de-273882591e67 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:25.865492 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7f0f1bfa-1d2a-4607-98de-273882591e67 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:25.872505 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7f0f1bfa-1d2a-4607-98de-273882591e67 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1219 microversion: 2.1 time: 0.066343 Sep 09 04:48:25.873151 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 467/935] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:25 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:26.018331 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:48:26.020629 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:26.026522 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:26.027030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:26.027461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:26.028147 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:26.028591 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:26.029027 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:26.099425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6da9ad52-7046-4901-a1ab-f840310c201c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/action" status: 202 len: 0 microversion: 2.1 time: 0.085408 Sep 09 04:48:26.100276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 469/936] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:48:26 2022] POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:48:26.108501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:26.109147 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:26.116859 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:26.117643 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:26.118259 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:26.119175 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:26.119786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:26.120821 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:26.272794 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:26.281206 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ebc20a6d-f445-4021-92d4-4462e57477c7 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1750 microversion: 2.1 time: 0.176706 Sep 09 04:48:26.282971 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 468/937] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:26 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:26.897231 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:26.897851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:26.904135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:26.904620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:26.905060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:26.905755 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:26.906205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:26.906627 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:26.978433 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:26.987188 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-b59b3fe5-07c0-4262-b91a-0ba7199419b1 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1271 microversion: 2.1 time: 0.095081 Sep 09 04:48:26.987930 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 470/938] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:26 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:27.305603 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:27.306358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:27.314120 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:27.314614 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:27.315086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:27.315787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:27.316240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:27.317419 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:27.466290 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:27.475106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-fb45cbc9-7484-48d2-a0a4-db58cf3a87e6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.173439 Sep 09 04:48:27.475763 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 469/939] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:27 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:28.010195 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:28.010759 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:28.017119 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:28.017606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:28.018050 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:28.018750 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:28.019252 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:28.019682 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:28.147491 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:28.155216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e3d6a6aa-8145-41d8-9408-c4dd246067aa tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1319 microversion: 2.1 time: 0.149023 Sep 09 04:48:28.155778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 471/940] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:28 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:28.389640 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-0af02e28-bfe8-4f6d-9f7e-79877a703101 req-0dede450-7312-40eb-824c-9cd19fe3bf3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d31339-e7f5-4cbf-b289-4be118799e91", "tag": "975d5f75-495a-4a76-b117-7342cfdada62"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:48:28.400460 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-0af02e28-bfe8-4f6d-9f7e-79877a703101 req-0dede450-7312-40eb-824c-9cd19fe3bf3e service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:28.401213 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-0af02e28-bfe8-4f6d-9f7e-79877a703101 req-0dede450-7312-40eb-824c-9cd19fe3bf3e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:28.401652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-0af02e28-bfe8-4f6d-9f7e-79877a703101 req-0dede450-7312-40eb-824c-9cd19fe3bf3e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:28.413059 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-0af02e28-bfe8-4f6d-9f7e-79877a703101 req-0dede450-7312-40eb-824c-9cd19fe3bf3e service nova] Creating event network-changed:975d5f75-495a-4a76-b117-7342cfdada62 for instance c5d31339-e7f5-4cbf-b289-4be118799e91 on hv-cinder-85600 Sep 09 04:48:28.418191 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-0af02e28-bfe8-4f6d-9f7e-79877a703101 req-0dede450-7312-40eb-824c-9cd19fe3bf3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032316 Sep 09 04:48:28.418774 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 470/941] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:48:28.500748 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:28.501462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:28.507614 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:28.508090 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:28.508518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:28.509200 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:28.509646 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:28.510065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:28.660706 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:28.668934 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-54505747-2a2c-4004-9501-e6851258beef tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.172029 Sep 09 04:48:28.670135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 472/942] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:28 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:29.179416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:29.180116 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:29.186717 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:29.187239 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:29.187679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:29.188365 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:29.188816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:29.189240 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:29.315352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:29.323598 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b49f568f-6007-4c86-922c-c77b74085e88 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1319 microversion: 2.1 time: 0.148953 Sep 09 04:48:29.324159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 471/943] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:29 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:29.693133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:29.693732 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:29.700157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:29.700636 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:29.701064 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:29.701747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:29.702198 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:29.702613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:29.994764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:30.003020 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2fea7291-cee5-4826-907b-196dd6f1140e tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.313931 Sep 09 04:48:30.003581 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 473/944] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:29 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:30.345567 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:30.346182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:30.352666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:30.353157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:30.353600 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:30.354297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:30.354755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:30.355211 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:30.481242 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:30.489215 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-69ee393d-5dbc-486b-b12b-70f01880e730 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1319 microversion: 2.1 time: 0.147045 Sep 09 04:48:30.489768 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 472/945] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:30 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:31.025933 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:31.026565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:31.032899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:31.033385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:31.033825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:31.034517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:31.035005 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:31.035932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:31.173038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:31.181758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3379f535-4a54-45e6-9b77-ce9341854272 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.159647 Sep 09 04:48:31.182309 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 474/946] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:31 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:31.511498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:31.512140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:31.518465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:31.518975 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:31.519424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:31.520659 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:31.521113 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:31.521542 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:31.651070 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:31.658859 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-1a86ef14-9be8-4c67-a2b3-a170607131f3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1319 microversion: 2.1 time: 0.151320 Sep 09 04:48:31.659450 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 473/947] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:31 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:48:32.205074 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:32.205679 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:32.212082 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:32.212559 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:32.212989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:32.213675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:32.214125 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:32.214543 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:32.354189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:32.362524 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-294b76f5-86f5-407b-aeb5-257977925ae4 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.161352 Sep 09 04:48:32.363127 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 475/948] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:32 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:32.682141 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:32.682809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:32.689252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:32.689735 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:32.690176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:32.690868 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:32.691351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:32.691828 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:32.826701 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:32.841827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e4fa9293-6c93-4ac0-bbf8-271e45cb9ab7 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1319 microversion: 2.1 time: 0.163638 Sep 09 04:48:32.842626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 474/949] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:32 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:32.860967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-cff81608-1a31-48cc-abab-dfd04d81e72e req-6b6b0823-9fc8-48a2-a38c-81d0bbe39a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d31339-e7f5-4cbf-b289-4be118799e91", "name": "network-vif-plugged", "status": "completed", "tag": "975d5f75-495a-4a76-b117-7342cfdada62"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:48:32.871456 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cff81608-1a31-48cc-abab-dfd04d81e72e req-6b6b0823-9fc8-48a2-a38c-81d0bbe39a41 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:32.871943 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cff81608-1a31-48cc-abab-dfd04d81e72e req-6b6b0823-9fc8-48a2-a38c-81d0bbe39a41 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:32.872407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-cff81608-1a31-48cc-abab-dfd04d81e72e req-6b6b0823-9fc8-48a2-a38c-81d0bbe39a41 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:32.883213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-cff81608-1a31-48cc-abab-dfd04d81e72e req-6b6b0823-9fc8-48a2-a38c-81d0bbe39a41 service nova] Creating event network-vif-plugged:975d5f75-495a-4a76-b117-7342cfdada62 for instance c5d31339-e7f5-4cbf-b289-4be118799e91 on hv-cinder-85600 Sep 09 04:48:32.888057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-cff81608-1a31-48cc-abab-dfd04d81e72e req-6b6b0823-9fc8-48a2-a38c-81d0bbe39a41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030904 Sep 09 04:48:32.888662 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 476/950] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:48:33.386073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:33.386678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:33.392585 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:33.393063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:33.393498 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:33.394179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:33.394630 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:33.395074 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:33.532292 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:33.541068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-5a055c76-b0f3-41df-8d06-a8aa4c5856bb tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.158852 Sep 09 04:48:33.541618 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 475/951] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:33 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:48:33.866120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:33.866734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:33.872860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:33.873333 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:33.873764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:33.874440 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:33.874885 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:33.875328 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:34.004827 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:34.012393 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-04d60805-bdb4-4c84-913b-02f0d6ba97d4 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1319 microversion: 2.1 time: 0.151084 Sep 09 04:48:34.012963 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 477/952] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:33 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:34.564411 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:34.564964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:34.572533 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:34.573015 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:34.573461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:34.574455 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:34.574908 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:34.575362 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:34.717544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:34.728515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e2d92b91-9e59-4eaf-9e61-a346970ac2dd tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.168101 Sep 09 04:48:34.729085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 476/953] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:34 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:35.035103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:35.036272 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:35.042517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:35.043025 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:35.043459 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:35.044140 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:35.044588 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:35.045008 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:35.170706 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:35.178300 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d9845155-e1ac-46ca-9455-0606154c7a50 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1508 microversion: 2.1 time: 0.147118 Sep 09 04:48:35.178847 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 478/954] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:35 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:35.200781 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "400a2225-f2eb-4b99-a922-18f63fe4d39f", "device": "/dev/sdb"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:48:35.203305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:35.210177 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:35.210711 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:35.211181 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:35.211886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:35.212343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:35.212773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:35.464404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0d83a53d-e37d-41eb-a40b-c3255fb9cb1e tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "POST /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267503 Sep 09 04:48:35.465133 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 477/955] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Sep 9 04:48:35 2022] POST /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:48:35.752111 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:35.752720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:35.755405 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:35.756077 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=6 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:35.762268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:35.762762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:35.763230 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:35.763930 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:35.764388 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:35.764816 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:35.909851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:35.918113 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-45d78c5d-36fd-472b-991e-32d27afbc67f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.169898 Sep 09 04:48:35.918619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 479/956] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:35 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:36.942740 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:36.946866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:36.947592 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:36.953872 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:36.954351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:36.954785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:36.955494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:36.955945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:36.956367 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:37.096052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:37.104207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-42d4af16-78b1-4922-af1f-5b8aec649727 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.163730 Sep 09 04:48:37.104767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 478/957] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:36 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:38.127008 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:38.127606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:38.134142 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:38.134619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:38.135088 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:38.135778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:38.136230 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:38.136655 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:38.294154 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:38.302343 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d9175314-92fc-403a-a3b4-861e0671b7c3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.179274 Sep 09 04:48:38.302903 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 480/958] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:38 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:39.325809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:39.326418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:39.332922 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:39.333412 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:39.333848 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:39.334540 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:39.335025 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:39.335454 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:39.353384 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:39.475866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:39.483995 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b8415ed9-b655-436a-87cf-e6f299c1c389 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.162014 Sep 09 04:48:39.484553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 479/959] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:39 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:40.508403 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:40.509047 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:40.515574 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:40.516003 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:40.516442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:40.517141 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:40.517598 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:40.518029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:40.521870 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:40.662029 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:40.670255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-57af5f77-c3bf-4028-8164-19ed71f2dca5 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.166299 Sep 09 04:48:40.670824 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 481/960] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:40 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:41.696146 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:41.696755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:41.703183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:41.703680 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:41.704126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:41.704829 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:41.705288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:41.705725 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:41.844935 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:41.853435 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f4d9fd66-d555-4858-a624-d847610b6bb6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.162076 Sep 09 04:48:41.854254 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 480/961] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:41 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:42.883864 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:42.884473 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:42.886826 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:42.892404 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:42.892900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:42.893327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:42.894082 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:42.895135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:42.895564 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:43.048621 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:43.057215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-193a50cf-7d93-4a9a-88f8-6e7d96f52b20 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1755 microversion: 2.1 time: 0.177195 Sep 09 04:48:43.057797 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 482/962] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:42 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:44.080810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:44.081448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:44.084284 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:44.089522 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:44.090011 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:44.090452 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:44.091180 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:44.091641 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:44.092068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:44.234996 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:44.243288 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-7ae709e5-526c-4abf-b15b-9b17534665c9 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1758 microversion: 2.1 time: 0.166356 Sep 09 04:48:44.243845 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 481/963] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:44 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:54.980533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:54.981036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:54.983190 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:54.984195 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=10 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:54.991158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:54.991638 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:54.992068 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:54.992754 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:54.993205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:54.993635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:55.075146 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lazy-loading 'services' on Instance uuid c5d31339-e7f5-4cbf-b289-4be118799e91 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:48:55.144554 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a43f2d4e-2381-4127-8bfb-06e587eafe71 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91/os-volume_attachments/400a2225-f2eb-4b99-a922-18f63fe4d39f" status: 202 len: 0 microversion: 2.1 time: 0.167631 Sep 09 04:48:55.145126 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 483/964] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:48:54 2022] DELETE /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91/os-volume_attachments/400a2225-f2eb-4b99-a922-18f63fe4d39f => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:48:56.263816 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:56.264295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:56.266748 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:56.267440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=14 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:48:56.273373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:56.273855 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:56.274289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:56.275010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:56.275466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:56.275891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:56.300787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:48:56.377184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3f840b96-9e0d-4c9c-b7fd-1a71a69bd993 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 204 len: 0 microversion: 2.1 time: 0.116740 Sep 09 04:48:56.378036 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 482/965] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:48:56 2022] DELETE /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:48:56.388875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:56.390028 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:56.396159 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:56.396646 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:56.397083 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:56.397774 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:56.398229 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:56.398657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:56.526784 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:56.534451 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-551bb088-8f0f-4c36-9cb1-53c118ba60e3 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1514 microversion: 2.1 time: 0.151347 Sep 09 04:48:56.535533 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 484/966] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:56 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:48:57.558393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:57.559032 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:57.565429 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:57.566569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:57.567042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:57.568004 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:57.568461 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:57.568886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:57.826554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:57.834193 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d31fe8c1-ac5e-4f48-b493-6f02b0bb5957 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1514 microversion: 2.1 time: 0.280177 Sep 09 04:48:57.834753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 483/967] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:57 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:58.729640 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-79798fb1-80c1-47d0-97e3-2b0045f7cd18 req-e149d21f-216b-4409-ae68-fcdbae4c7ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d31339-e7f5-4cbf-b289-4be118799e91", "name": "network-vif-deleted", "tag": "975d5f75-495a-4a76-b117-7342cfdada62"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:48:58.741677 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-79798fb1-80c1-47d0-97e3-2b0045f7cd18 req-e149d21f-216b-4409-ae68-fcdbae4c7ee8 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:58.742240 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-79798fb1-80c1-47d0-97e3-2b0045f7cd18 req-e149d21f-216b-4409-ae68-fcdbae4c7ee8 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:58.742680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-79798fb1-80c1-47d0-97e3-2b0045f7cd18 req-e149d21f-216b-4409-ae68-fcdbae4c7ee8 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:58.754557 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-79798fb1-80c1-47d0-97e3-2b0045f7cd18 req-e149d21f-216b-4409-ae68-fcdbae4c7ee8 service nova] Creating event network-vif-deleted:975d5f75-495a-4a76-b117-7342cfdada62 for instance c5d31339-e7f5-4cbf-b289-4be118799e91 on hv-cinder-85600 Sep 09 04:48:58.759865 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-79798fb1-80c1-47d0-97e3-2b0045f7cd18 req-e149d21f-216b-4409-ae68-fcdbae4c7ee8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033897 Sep 09 04:48:58.760473 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 485/968] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:48:58.857660 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:58.858278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:58.864716 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:58.865195 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:58.865637 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:58.866326 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:58.866780 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:58.867229 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:58.899363 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:58.899964 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:58.900699 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:58.900986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lazy-loading 'fault' on Instance uuid c5d31339-e7f5-4cbf-b289-4be118799e91 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:48:58.949953 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2703b4f1781e4f009d51f0929d6c555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40e149178c6430bac065ed46db7dbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:48:58.958728 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-cf44e745-1c65-4f62-b1a9-4439b6664744 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 200 len: 1309 microversion: 2.1 time: 0.104850 Sep 09 04:48:58.965127 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 484/969] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:58 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:48:59.982498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:48:59.983261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] [instance: c5d31339-e7f5-4cbf-b289-4be118799e91] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:48:59.989287 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:59.989762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:59.990196 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:48:59.990875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:48:59.991353 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:48:59.991770 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:00.004555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] HTTP exception thrown: Instance c5d31339-e7f5-4cbf-b289-4be118799e91 could not be found. Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Request method failure captured: Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 HTTP/1.1 Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsVV41446qHQwZSTCyC59F8em5WbFlWkOMcPkt0wuEYqnqKs4wYYubJxF1izeuvJwIAksR1Q_nfztz6xoiyFGjf8I7fjnzkyySflvlMYIEDoEBpaE9h2CMksF5ehG5_aCEmnswRKPNSdZ4wymsDg5RoJYcQzBK6IAqSTn5Pssjq08oc Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: e40e149178c6430bac065ed46db7dbf8 Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-VolumesSnapshotTestJSON-175283707 Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:49:00.006129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e40e149178c6430bac065ed46db7dbf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e40e149178c6430bac065ed46db7dbf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e40e149178c6430bac065ed46db7dbf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e40e149178c6430bac065ed46db7dbf8"}]}] Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-VolumesSnapshotTestJSON-175283707 Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: e40e149178c6430bac065ed46db7dbf8 Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-175283707 Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-VolumesSnapshotTestJSON-175283707-project Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 2703b4f1781e4f009d51f0929d6c555b Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-VolumesSnapshotTestJSON-175283707-project Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance c5d31339-e7f5-4cbf-b289-4be118799e91 could not be found. Sep 09 04:49:00.007965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'c5d31339-e7f5-4cbf-b289-4be118799e91'} Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d31339-e7f5-4cbf-b289-4be118799e91 could not be found. Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:49:00.008932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d31339-e7f5-4cbf-b289-4be118799e91 could not be found. Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d31339-e7f5-4cbf-b289-4be118799e91 could not be found. Sep 09 04:49:00.010506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:00.011962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] Returning 404 to user: Instance c5d31339-e7f5-4cbf-b289-4be118799e91 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:49:00.011962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-876440ce-7835-4c94-9ff6-9fac19869572 tempest-VolumesSnapshotTestJSON-175283707 tempest-VolumesSnapshotTestJSON-175283707-project] 10.222.0.20 "GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91" status: 404 len: 111 microversion: 2.1 time: 0.029691 Sep 09 04:49:00.011962 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 486/970] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:48:59 2022] GET /compute/v2.1/servers/c5d31339-e7f5-4cbf-b289-4be118799e91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:49:22.788322 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-299727311"}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:22.789024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:22.792925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:22.793525 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:22.794306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 04:49:22.794501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Fri Sep 9 04:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/action (ip 10.222.0.20) !!! Sep 09 04:49:22.800758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:22.801249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:22.801690 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:22.802413 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:22.802851 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:22.803308 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:22.934347 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.network.security_group_api [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Removing security group 46d0b1af-8c96-4e04-9f6a-18b1cbaccfb5 from port 715e0a6e-e934-4e7a-a87d-74f1376050a2 Sep 09 04:49:23.280488 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0d4dba4f-526f-41a9-be11-cde659fe1a5b tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/action" status: 202 len: 0 microversion: 2.1 time: 0.496782 Sep 09 04:49:23.284798 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 485/971] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:49:22 2022] POST /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 04:49:23.294909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-00a08069-8984-426d-8086-63b42871e875 req-998b2313-d1ec-4a0e-bd03-becfe9594433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d0ca27-c29c-4997-90b3-0f50e0ce7af6", "tag": "715e0a6e-e934-4e7a-a87d-74f1376050a2"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:23.306454 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=8 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:23.307871 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:23.311018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 04:49:23.311446 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Fri Sep 9 04:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 09 04:49:23.314834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-00a08069-8984-426d-8086-63b42871e875 req-998b2313-d1ec-4a0e-bd03-becfe9594433 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:23.316562 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-00a08069-8984-426d-8086-63b42871e875 req-998b2313-d1ec-4a0e-bd03-becfe9594433 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:23.317544 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-00a08069-8984-426d-8086-63b42871e875 req-998b2313-d1ec-4a0e-bd03-becfe9594433 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:23.337284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-00a08069-8984-426d-8086-63b42871e875 req-998b2313-d1ec-4a0e-bd03-becfe9594433 service nova] Creating event network-changed:715e0a6e-e934-4e7a-a87d-74f1376050a2 for instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 on hv-cinder-85600 Sep 09 04:49:23.358701 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-00a08069-8984-426d-8086-63b42871e875 req-998b2313-d1ec-4a0e-bd03-becfe9594433 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068824 Sep 09 04:49:23.361217 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 487/972] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:49:24.787063 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:24.787692 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:24.794616 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:24.795148 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:24.795589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:24.796286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:24.796739 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:24.797159 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:24.887346 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lazy-loading 'services' on Instance uuid f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:49:24.986221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4be79018-c119-4a32-879e-9994d819d439 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments/f8b06dba-776e-4d56-95aa-5ec888ebeff2" status: 202 len: 0 microversion: 2.1 time: 0.203304 Sep 09 04:49:24.987834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 486/973] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:49:24 2022] DELETE /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments/f8b06dba-776e-4d56-95aa-5ec888ebeff2 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:49:25.008102 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:25.011516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:25.032855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:25.034097 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:25.034613 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:25.035715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:25.036623 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:25.037323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:25.078923 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-87c3d915-53d4-41ec-b7d1-28c278b3b55a tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084968 Sep 09 04:49:25.079924 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 488/974] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:49:24 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:49:25.387477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-0349ab62-e1e4-4e08-a42b-a6f35dd5cae7 req-74df807a-636f-42a9-98a2-0ebffcb6874c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d0ca27-c29c-4997-90b3-0f50e0ce7af6", "tag": "715e0a6e-e934-4e7a-a87d-74f1376050a2"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:25.401011 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-0349ab62-e1e4-4e08-a42b-a6f35dd5cae7 req-74df807a-636f-42a9-98a2-0ebffcb6874c service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:25.403173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-0349ab62-e1e4-4e08-a42b-a6f35dd5cae7 req-74df807a-636f-42a9-98a2-0ebffcb6874c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:25.403916 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-0349ab62-e1e4-4e08-a42b-a6f35dd5cae7 req-74df807a-636f-42a9-98a2-0ebffcb6874c service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:25.415777 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-0349ab62-e1e4-4e08-a42b-a6f35dd5cae7 req-74df807a-636f-42a9-98a2-0ebffcb6874c service nova] Creating event network-changed:715e0a6e-e934-4e7a-a87d-74f1376050a2 for instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 on hv-cinder-85600 Sep 09 04:49:25.422061 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-0349ab62-e1e4-4e08-a42b-a6f35dd5cae7 req-74df807a-636f-42a9-98a2-0ebffcb6874c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039014 Sep 09 04:49:25.424086 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 487/975] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:49:26.094408 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:26.100557 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:26.107493 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:26.107977 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:26.108501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:26.109337 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:26.110100 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:26.110843 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:26.151045 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-c3ab35a7-06d6-48dc-b393-debb9bdecd60 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061927 Sep 09 04:49:26.152412 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 489/976] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Sep 9 04:49:26 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 04:49:26.164933 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:26.165543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:26.173664 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:26.174470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:26.175112 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:26.175992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:26.176448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:26.176875 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:26.266352 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] HTTP exception thrown: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 is not attached to volume f8b06dba-776e-4d56-95aa-5ec888ebeff2 Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Request method failure captured: Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments/f8b06dba-776e-4d56-95aa-5ec888ebeff2 HTTP/1.1 Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsU2cz2pqrwKnssUIVZh9ZCC0_fiGA13ng7s8VUxwu6zw0ehPwtjnErlGQeJ-YbyT5GA59tnWScaT970hCMlWRVXwfdxzcPCp1sBJ27BUNbBievtSiObBTHz5QdivCcwSynQT2ELg4gORqO_6DxSSk9lS0rx79rsy000PxMxCYO84pM Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: 9931b1bca2464db7bcb90b91567cab28 Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-TestMinimumBasicScenario-1833912569 Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:49:26.269379 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9931b1bca2464db7bcb90b91567cab28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9931b1bca2464db7bcb90b91567cab28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9931b1bca2464db7bcb90b91567cab28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9931b1bca2464db7bcb90b91567cab28"}]}] Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-TestMinimumBasicScenario-1833912569 Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: 9931b1bca2464db7bcb90b91567cab28 Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1833912569 Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-TestMinimumBasicScenario-1833912569-project Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: c163b2e8db43490196e93b5fe4d45378 Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-TestMinimumBasicScenario-1833912569-project Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:49:26.270983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 is not attached to volume f8b06dba-776e-4d56-95aa-5ec888ebeff2 Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'server_id': 'f8d0ca27-c29c-4997-90b3-0f50e0ce7af6', 'id': 'f8b06dba-776e-4d56-95aa-5ec888ebeff2'} Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f8b06dba-776e-4d56-95aa-5ec888ebeff2. Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:49:26.271788 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 is not attached to volume f8b06dba-776e-4d56-95aa-5ec888ebeff2 Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 is not attached to volume f8b06dba-776e-4d56-95aa-5ec888ebeff2 Sep 09 04:49:26.273214 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:26.275554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Returning 404 to user: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 is not attached to volume f8b06dba-776e-4d56-95aa-5ec888ebeff2 {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:49:26.276638 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2d2a544e-cc9f-4dd9-93c8-b47d73936440 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments/f8b06dba-776e-4d56-95aa-5ec888ebeff2" status: 404 len: 154 microversion: 2.1 time: 0.117578 Sep 09 04:49:26.277430 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 488/977] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Sep 9 04:49:26 2022] DELETE /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6/os-volume_attachments/f8b06dba-776e-4d56-95aa-5ec888ebeff2 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:49:27.427861 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:27.429041 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:27.435940 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:27.436715 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:27.437396 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:27.438323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:27.439012 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:27.439652 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:27.474694 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:49:27.555940 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8ebdafe7-c5e3-4789-ab30-e118de36b30c tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 204 len: 0 microversion: 2.1 time: 0.131980 Sep 09 04:49:27.560233 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 490/978] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:49:27 2022] DELETE /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:49:27.565572 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:27.566853 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:27.575059 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:27.575798 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:27.576353 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:27.577216 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:27.577781 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:27.578280 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:27.797554 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:27.807247 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e77bdfc7-6b9d-4dfe-84c4-f8577d473012 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1554 microversion: 2.1 time: 0.245453 Sep 09 04:49:27.807914 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 489/979] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:27 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:28.831377 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:28.832088 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:28.840181 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:28.840673 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:28.841107 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:28.843317 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:28.843981 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:28.844492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:29.249046 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:29.260442 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-425e722b-8efc-4a12-8387-f258158441e3 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1554 microversion: 2.1 time: 0.433317 Sep 09 04:49:29.262051 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 491/980] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:28 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1554 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:30.302672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:30.304373 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:30.328465 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:30.328973 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:30.329416 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:30.330349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:30.330946 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:30.331843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:30.388603 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-36db1420-2e15-44b5-a817-1b36859544a4 req-bd20a21a-2052-43e1-90f1-31623821b914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d0ca27-c29c-4997-90b3-0f50e0ce7af6", "name": "network-vif-deleted", "tag": "715e0a6e-e934-4e7a-a87d-74f1376050a2"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:30.429148 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c163b2e8db43490196e93b5fe4d45378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9931b1bca2464db7bcb90b91567cab28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:30.429600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-36db1420-2e15-44b5-a817-1b36859544a4 req-bd20a21a-2052-43e1-90f1-31623821b914 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:30.430094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-36db1420-2e15-44b5-a817-1b36859544a4 req-bd20a21a-2052-43e1-90f1-31623821b914 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:30.430690 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-36db1420-2e15-44b5-a817-1b36859544a4 req-bd20a21a-2052-43e1-90f1-31623821b914 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:30.444352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-36db1420-2e15-44b5-a817-1b36859544a4 req-bd20a21a-2052-43e1-90f1-31623821b914 service nova] Creating event network-vif-deleted:715e0a6e-e934-4e7a-a87d-74f1376050a2 for instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 on hv-cinder-85600 Sep 09 04:49:30.450036 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-36db1420-2e15-44b5-a817-1b36859544a4 req-bd20a21a-2052-43e1-90f1-31623821b914 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065628 Sep 09 04:49:30.450630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 492/981] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:49:30.451849 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9184aecb-c6c4-45b3-a784-6b698ac1c5b6 tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 200 len: 1512 microversion: 2.1 time: 0.158107 Sep 09 04:49:30.452888 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 490/982] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:30 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:31.477186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:31.477878 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] [instance: f8d0ca27-c29c-4997-90b3-0f50e0ce7af6] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:31.485305 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:31.486358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:31.487620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:31.488388 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:31.488839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:31.489238 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:31.505844 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] HTTP exception thrown: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 could not be found. Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Request method failure captured: Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 HTTP/1.1 Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsU2cz2pqrwKnssUIVZh9ZCC0_fiGA13ng7s8VUxwu6zw0ehPwtjnErlGQeJ-YbyT5GA59tnWScaT970hCMlWRVXwfdxzcPCp1sBJ27BUNbBievtSiObBTHz5QdivCcwSynQT2ELg4gORqO_6DxSSk9lS0rx79rsy000PxMxCYO84pM Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 9931b1bca2464db7bcb90b91567cab28 Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-TestMinimumBasicScenario-1833912569 Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:49:31.507960 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9931b1bca2464db7bcb90b91567cab28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9931b1bca2464db7bcb90b91567cab28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9931b1bca2464db7bcb90b91567cab28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9931b1bca2464db7bcb90b91567cab28"}]}] Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-TestMinimumBasicScenario-1833912569 Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 9931b1bca2464db7bcb90b91567cab28 Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1833912569 Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-TestMinimumBasicScenario-1833912569-project Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: c163b2e8db43490196e93b5fe4d45378 Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-TestMinimumBasicScenario-1833912569-project Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 could not be found. Sep 09 04:49:31.509418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'f8d0ca27-c29c-4997-90b3-0f50e0ce7af6'} Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 could not be found. Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:49:31.510555 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 could not be found. Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 could not be found. Sep 09 04:49:31.511955 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:49:31.513202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Returning 404 to user: Instance f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:49:31.513202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e75fa584-339d-4561-a1a9-a129ccf79d9f tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6" status: 404 len: 111 microversion: 2.1 time: 0.036843 Sep 09 04:49:31.513202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 493/983] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:31 2022] GET /compute/v2.1/servers/f8d0ca27-c29c-4997-90b3-0f50e0ce7af6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:49:31.518099 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b920e441-5553-4aae-8531-18a72cafb9dc tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] Calling method '.version_select at 0x7f43fab95f70>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:31.543662 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b920e441-5553-4aae-8531-18a72cafb9dc tempest-TestMinimumBasicScenario-1833912569 tempest-TestMinimumBasicScenario-1833912569-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1635143123" status: 202 len: 0 microversion: 2.1 time: 0.029303 Sep 09 04:49:31.544534 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 491/984] 10.222.0.20 () {58 vars in 1272 bytes} [Fri Sep 9 04:49:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1635143123 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:49:35.218232 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-68115140-b684-4413-a49c-624ac3456ab9 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Action: 'create', calling method: .version_select at 0x7f43fabc45e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1201854408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMF01Z+zgxO73mtIrmrJY2Gy0+Uv4yDFkJWKdFEXTaLXWfb1KafBhY1AjW4vpiKIpFrrNY+AMSZTBR2Ysxi5bJa9rrZvkT8TdlwQPsY5ywAWQJLgTMWK8b+nc1Fs2HUOg=="}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:35.242948 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-68115140-b684-4413-a49c-624ac3456ab9 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Getting quotas for project 78feec3c37b84399ba54e70b4e5a1e08. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:49:35.249153 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-68115140-b684-4413-a49c-624ac3456ab9 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Getting quotas for user deab6d2c9e1f429ca593f92669deab9c and project 78feec3c37b84399ba54e70b4e5a1e08. Resources: {'key_pairs'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:49:35.284854 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-68115140-b684-4413-a49c-624ac3456ab9 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.300779 Sep 09 04:49:35.287165 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 494/985] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Sep 9 04:49:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:49:47.308287 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:47.308885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:47.311107 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:47.311753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:47.321745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:47.322277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:47.322719 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:47.323475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:47.323938 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:47.324368 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:47.350810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:49:47.428436 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4a197296-1441-453e-a4c6-afce7dc4eb8d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 204 len: 0 microversion: 2.1 time: 0.124066 Sep 09 04:49:47.429043 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 492/986] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:49:47 2022] DELETE /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 04:49:47.434780 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:47.435734 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=4 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:47.436385 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:49:47.440361 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:47.441063 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:47.450133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:47.450691 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:47.451157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:47.451848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:47.452299 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:47.452720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:47.589969 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:47.598504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-196d144a-4122-489e-9a9e-51be6dd23992 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1577 microversion: 2.1 time: 0.165159 Sep 09 04:49:47.599094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 495/987] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:47 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:48.622766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:48.623427 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:48.630474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:48.630987 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:48.631431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:48.632123 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:48.632576 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:48.633001 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:48.761672 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:48.769448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-820caa1b-8839-4ce8-ad86-c922dcdc6271 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1577 microversion: 2.1 time: 0.150980 Sep 09 04:49:48.770007 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 493/988] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:48 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:49.791818 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:49.792357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:49.798720 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:49.799213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:49.799663 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:49.800534 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:49.801145 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:49.801733 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:49.865874 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:49.874432 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6500f32b-f962-4a92-af6c-7924b6dcf4ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1510 microversion: 2.1 time: 0.086591 Sep 09 04:49:49.875192 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 496/989] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:49 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1510 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:50.140184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-2deff639-ab26-4756-8716-9987260305f4 req-3f47132e-e6eb-4a9d-9bb9-2b204e00ea37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c35f607e-1028-4a37-8027-e86b1a8a9875", "name": "network-vif-deleted", "tag": "5deef0e3-2202-4301-8d8f-a3be3fc97d38"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:50.152827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-2deff639-ab26-4756-8716-9987260305f4 req-3f47132e-e6eb-4a9d-9bb9-2b204e00ea37 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:50.153312 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-2deff639-ab26-4756-8716-9987260305f4 req-3f47132e-e6eb-4a9d-9bb9-2b204e00ea37 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:50.153742 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-2deff639-ab26-4756-8716-9987260305f4 req-3f47132e-e6eb-4a9d-9bb9-2b204e00ea37 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:50.166834 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-2deff639-ab26-4756-8716-9987260305f4 req-3f47132e-e6eb-4a9d-9bb9-2b204e00ea37 service nova] Creating event network-vif-deleted:5deef0e3-2202-4301-8d8f-a3be3fc97d38 for instance c35f607e-1028-4a37-8027-e86b1a8a9875 on hv-cinder-85600 Sep 09 04:49:50.174410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-2deff639-ab26-4756-8716-9987260305f4 req-3f47132e-e6eb-4a9d-9bb9-2b204e00ea37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037273 Sep 09 04:49:50.175552 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 494/990] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:49:50.898182 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:50.899468 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:50.906205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:50.906689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:50.907205 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:50.907906 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:50.908355 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:50.908775 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:50.941789 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:50.942266 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:50.942975 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:50.943421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lazy-loading 'fault' on Instance uuid c35f607e-1028-4a37-8027-e86b1a8a9875 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:49:50.984799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:50.992635 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3860a115-a699-48dd-900a-1f3a4070bdfc tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 200 len: 1230 microversion: 2.1 time: 0.098889 Sep 09 04:49:50.993423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 497/991] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:50 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:52.015393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:52.016090 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:52.022583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:52.023094 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:52.023537 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:52.024230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:52.024683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:52.025106 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:52.038645 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] HTTP exception thrown: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Request method failure captured: Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 HTTP/1.1 Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsU1N94QspC1-0zmzgvR8JcQTNrzmEgcZ2u7YHbgoZPI8q2dJH2E9sCUKGXqKe8tBS6OFdfr-CMsNePdat7HL3_AVbvv9BqAmNbkpuhecIYFgwb4ja6sHiGJhnXBf0HVyb3ctNl19qtkPYUIcnJmTdxaT2sU90q4cx9lIMhS3k_Hkyw Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:49:52.040303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ea4c285aae544f47a91407ff79414128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ea4c285aae544f47a91407ff79414128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}] Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-TestVolumeBootPattern-241937363 Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 9ece0d7befa845c0ab2a33bfb10b7850 Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:49:52.041936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'c35f607e-1028-4a37-8027-e86b1a8a9875'} Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:49:52.042920 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:49:52.044490 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:49:52.045910 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Returning 404 to user: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:49:52.045910 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9a46a372-63ca-4231-99d3-511f52ef6eb3 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 404 len: 111 microversion: 2.1 time: 0.030584 Sep 09 04:49:52.045910 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 495/992] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:52 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:49:52.144660 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1062531120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-488796557", "security_groups": [{"name": "tempest-secgroup-smoke-935715260"}], "block_device_mapping_v2": [{"uuid": "d214c94c-2c43-4dd1-bd91-b74316a8385b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8fb0b6b-bb8d-429d-b190-f0ae97f77f01"}]}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:52.260244 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.network.neutron [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] validate_networks() for [('c8fb0b6b-bb8d-429d-b190-f0ae97f77f01', None, None, None, None, None)] {{(pid=127436) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:49:52.510140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1702977911", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1201854408", "security_groups": [{"name": "tempest-secgroup-smoke-1898783231"}], "networks": [{"uuid": "60891183-f016-4a6f-97e3-956ad10ca1c0"}], "block_device_mapping_v2": [{"uuid": "1408f818-1eab-4729-9940-030f824c9620", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:52.693774 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] validate_networks() for [('60891183-f016-4a6f-97e3-956ad10ca1c0', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:49:52.718825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Flavor limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:49:52.719287 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Image limits 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:49:52.719782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Flavor pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:49:52.720186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Image pref 0:0:0 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:49:52.720592 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.virt.hardware [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127436) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:49:52.729213 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:52.729692 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:52.730120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:52.730841 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:52.731323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:52.731743 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:52.748352 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for project ea4c285aae544f47a91407ff79414128. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:49:52.752237 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.quota [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for user 9ece0d7befa845c0ab2a33bfb10b7850 and project ea4c285aae544f47a91407ff79414128. Resources: {'instances', 'ram', 'cores'} {{(pid=127436) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:49:52.811276 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Going to run 1 instances... {{(pid=127436) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:49:52.813443 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d214c94c-2c43-4dd1-bd91-b74316a8385b',volume_size=None,volume_type=None)] {{(pid=127436) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:49:52.946094 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f7a1a403-d16d-40e1-98e6-406fdab2c6f6 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805255 Sep 09 04:49:52.947072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 498/993] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:49:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:49:52.959931 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0b1926a6-a0ec-4e90-aa08-dd772b968b7f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:52.960739 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0b1926a6-a0ec-4e90-aa08-dd772b968b7f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:53.308935 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0b1926a6-a0ec-4e90-aa08-dd772b968b7f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:53.324274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0b1926a6-a0ec-4e90-aa08-dd772b968b7f tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1094 microversion: 2.1 time: 0.370107 Sep 09 04:49:53.338961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 499/994] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:52 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1094 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:49:53.391241 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:49:53.391733 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:49:53.392277 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:49:53.392685 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:49:53.393089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:49:53.401795 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:53.402382 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:53.402817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:53.403569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:53.404015 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:53.404433 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:53.422569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Getting quotas for project 78feec3c37b84399ba54e70b4e5a1e08. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:49:53.427362 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Getting quotas for user deab6d2c9e1f429ca593f92669deab9c and project 78feec3c37b84399ba54e70b4e5a1e08. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:49:53.488494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:49:53.490594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1408f818-1eab-4729-9940-030f824c9620',volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:49:53.623359 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [244a1748-5afa-4a26-bd55-392b6fbcfbf8] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 04:49:54.347619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:54.348329 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:54.355992 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:54.356484 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:54.356921 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:54.357617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:54.358066 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:54.358486 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:54.424628 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:54.432787 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e7e77211-717b-4738-852c-49f54e16e5bf tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1210 microversion: 2.1 time: 0.089017 Sep 09 04:49:54.433358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 500/995] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:54 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:49:54.633108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [244a1748-5afa-4a26-bd55-392b6fbcfbf8] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52040. Sep 09 04:49:54.638609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ae0e3377-def4-4b8c-9371-6940a67d3bf7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.132408 Sep 09 04:49:54.639469 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 496/996] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:49:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 2134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 04:49:54.650198 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-35701e57-0710-4217-9463-97c2288c5362 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:54.650801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-35701e57-0710-4217-9463-97c2288c5362 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:54.713215 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-35701e57-0710-4217-9463-97c2288c5362 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:54.722565 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-35701e57-0710-4217-9463-97c2288c5362 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1089 microversion: 2.1 time: 0.075879 Sep 09 04:49:54.723621 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 501/997] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:54 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:55.458574 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:55.459618 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:55.468010 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:55.468652 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:55.469278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:55.470019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:55.470470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:55.470890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:55.618115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:55.628539 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f772de80-d27e-44a1-a00d-25ae08b87ee1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.175098 Sep 09 04:49:55.629117 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 497/998] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:55 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:49:55.747440 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:55.748054 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:55.755742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:55.756226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:55.756666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:55.757368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:55.757825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:55.758251 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:55.820570 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:55.828306 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a0b3dc54-4725-49eb-be17-27ce7a8a6855 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1187 microversion: 2.1 time: 0.084862 Sep 09 04:49:55.828875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 502/999] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:55 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:55.867559 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-067cc95a-98f0-464a-9590-e65fa0848287 req-d1535526-c9ca-4177-bd76-99288b49d015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47703db-953e-4fcb-8d5f-2cbcd4b7303f", "tag": "96c4e0a9-d0ac-410f-958e-9547ccdceafa"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:55.876988 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-067cc95a-98f0-464a-9590-e65fa0848287 req-d1535526-c9ca-4177-bd76-99288b49d015 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:55.877464 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-067cc95a-98f0-464a-9590-e65fa0848287 req-d1535526-c9ca-4177-bd76-99288b49d015 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:55.878433 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-067cc95a-98f0-464a-9590-e65fa0848287 req-d1535526-c9ca-4177-bd76-99288b49d015 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:55.896956 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-067cc95a-98f0-464a-9590-e65fa0848287 req-d1535526-c9ca-4177-bd76-99288b49d015 service nova] Creating event network-changed:96c4e0a9-d0ac-410f-958e-9547ccdceafa for instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f on hv-cinder-85600 Sep 09 04:49:55.902444 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-067cc95a-98f0-464a-9590-e65fa0848287 req-d1535526-c9ca-4177-bd76-99288b49d015 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038557 Sep 09 04:49:55.903666 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 498/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:49:56.651712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:56.652712 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:56.658740 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:56.659870 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:56.660254 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:56.661073 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:56.661640 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:56.662071 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:56.817293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:56.826007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d79e2e58-984b-4077-8a2e-bce63d00c0d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.178153 Sep 09 04:49:56.826584 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 503/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:56 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:56.853647 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:56.854473 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:56.861445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:56.861958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:56.862894 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:56.863642 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:56.864105 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:56.864561 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:56.934477 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:56.944650 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-dfdcdacc-5f08-47d4-a96c-6edf51747728 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1205 microversion: 2.1 time: 0.096023 Sep 09 04:49:56.945241 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 499/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:56 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:49:57.850711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:57.851327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:57.857737 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:57.858216 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:57.858648 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:57.859403 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:57.859855 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:57.860279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:57.967886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:57.968797 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:57.976077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:57.976705 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:57.977257 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:57.977974 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:57.978656 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:57.979125 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:58.006557 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:58.014447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-39fe17b8-d8db-481b-8f40-97eaa05653e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.168083 Sep 09 04:49:58.016773 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 504/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:57 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:58.110695 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:58.119145 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b71dec5a-6e13-4389-961d-6cd90d8ceec2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.155616 Sep 09 04:49:58.119720 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 500/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:57 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:49:58.193049 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-d8e01547-1982-44e6-a0cd-888baaacc38d req-2289d550-fad4-43d0-abbf-cc655db85d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dce54f-84c2-4623-a137-e4337b192c67", "tag": "c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:49:58.202517 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d8e01547-1982-44e6-a0cd-888baaacc38d req-2289d550-fad4-43d0-abbf-cc655db85d51 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:58.203171 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d8e01547-1982-44e6-a0cd-888baaacc38d req-2289d550-fad4-43d0-abbf-cc655db85d51 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:58.203619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d8e01547-1982-44e6-a0cd-888baaacc38d req-2289d550-fad4-43d0-abbf-cc655db85d51 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:58.216761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-d8e01547-1982-44e6-a0cd-888baaacc38d req-2289d550-fad4-43d0-abbf-cc655db85d51 service nova] Creating event network-changed:c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4 for instance 54dce54f-84c2-4623-a137-e4337b192c67 on hv-cinder-85600 Sep 09 04:49:58.221487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-d8e01547-1982-44e6-a0cd-888baaacc38d req-2289d550-fad4-43d0-abbf-cc655db85d51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032378 Sep 09 04:49:58.222640 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 505/1005] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:49:59.037583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:59.038201 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:59.044743 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:59.045231 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:59.045671 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:59.046369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:59.046829 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:59.047292 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:59.142900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:49:59.143710 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:49:59.149840 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:59.150595 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:59.151322 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:59.152320 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:49:59.152776 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:49:59.153199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:49:59.179706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:59.188069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-deae8297-ed63-484d-b035-5dcba7c837e7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.154327 Sep 09 04:49:59.189156 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 501/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:59 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:49:59.290850 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:49:59.298657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8b7e6c98-60de-4ff4-a33b-96d9eaa67818 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.160797 Sep 09 04:49:59.299255 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 506/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:49:59 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:00.211926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:00.212531 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:00.218951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:00.219444 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:00.219879 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:00.220571 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:00.221024 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:00.221445 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:00.322062 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:00.322677 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:00.329204 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:00.329688 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:00.330122 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:00.330810 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:00.331293 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:00.331714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:00.350333 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:00.358008 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-2299ab38-43b1-4714-828a-8506f7f2c084 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.149946 Sep 09 04:50:00.358575 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 502/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:00 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:00.462269 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:00.469831 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e24f6a90-52db-495f-8c3e-17e24f70aa4a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.152242 Sep 09 04:50:00.470391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 507/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:00 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:01.382158 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:01.382767 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:01.390073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:01.390558 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:01.391026 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:01.391741 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:01.392198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:01.392632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:01.493196 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:01.493820 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:01.500502 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:01.500989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:01.501425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:01.502120 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:01.502601 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:01.503716 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:01.524950 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:01.532730 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-991485a6-e68c-42bf-9a4a-24ae5544cdeb tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.155294 Sep 09 04:50:01.533607 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 503/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:01 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:01.628804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:01.636498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-db4212b4-1e4d-40dc-8eb9-2dd31c33de2a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.147133 Sep 09 04:50:01.637060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 508/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:01 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:02.555491 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:02.556050 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:02.562342 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:02.562818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:02.563278 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:02.563963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:02.564410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:02.564832 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:02.658489 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:02.659731 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:02.666183 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:02.666745 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:02.667284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:02.668057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:02.668582 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:02.669093 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:02.697073 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:02.704996 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-34981003-91fc-49b7-a9b6-75e6d92613b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.153375 Sep 09 04:50:02.705572 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 504/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:02 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:02.739149 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:50:02.801197 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:02.808792 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fa3a48b2-3c63-4cdf-84ce-0e02ef340b2e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.154184 Sep 09 04:50:02.809305 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 509/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:02 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:03.730342 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:03.730958 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:03.732890 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:50:03.733655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=6 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:50:03.740448 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:03.740925 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:03.741358 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:03.742038 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:03.742485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:03.742906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:03.831425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:03.832041 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:03.838405 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:03.838889 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:03.839361 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:03.840059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:03.840514 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:03.840945 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:03.875447 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:03.883065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-34130cc5-823d-4b69-b4d3-7ae899a20ba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.156525 Sep 09 04:50:03.883636 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 505/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:03 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:03.969885 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:03.978175 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-58a30ad8-0632-4b80-9f07-5e792421b870 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.150575 Sep 09 04:50:03.978735 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 510/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:03 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:04.905715 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:04.906317 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:04.913171 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:04.913644 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:04.914077 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:04.914756 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:04.915225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:04.915647 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:05.000230 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:05.000847 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:05.003877 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=10 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:50:05.008044 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:05.008542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:05.008981 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:05.009687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:05.010140 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:05.010563 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:05.058648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:05.067244 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-ea8bf80a-5d1f-4244-a761-03364300a0fd tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.165248 Sep 09 04:50:05.068517 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 506/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:04 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:05.141520 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:05.149699 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-242475dc-4994-4ae9-854c-5ebad6ca93d6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.153292 Sep 09 04:50:05.150268 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 511/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:04 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:06.090956 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:06.091583 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:06.099301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:06.099785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:06.100220 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:06.100915 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:06.101362 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:06.101784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:06.173158 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:06.173760 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:06.180761 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:06.181239 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:06.181674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:06.182360 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:06.182868 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:06.183345 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:06.242301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:06.250096 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e0401a7a-e340-4c87-b9cb-c614ab1e81e4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.163064 Sep 09 04:50:06.250578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 507/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:06 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:06.329860 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:06.337497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e5ae6dfd-7092-4c4c-9aa5-d01c93f44e5a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.168272 Sep 09 04:50:06.338059 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 512/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:06 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:07.272431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:07.273071 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:07.280472 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:07.280970 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:07.281415 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:07.282126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:07.282623 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:07.283085 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:07.360430 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:07.361866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:07.367882 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:07.368365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:07.368801 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:07.369501 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:07.369950 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:07.370371 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:07.468586 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:07.477321 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bfbf8fa7-77ff-40d1-922f-c24ed04bf9a8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.208789 Sep 09 04:50:07.490693 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 508/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:07 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:07.533499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:07.541254 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-30754aeb-48cb-414b-b8da-ff7085203d6c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.184699 Sep 09 04:50:07.541957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 513/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:07 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:07.740423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-72ba4609-1ff8-46a9-8bb8-ca21e5b8c06a req-97b16651-2cf5-43dd-acf3-a47b03a4da87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47703db-953e-4fcb-8d5f-2cbcd4b7303f", "name": "network-vif-plugged", "status": "completed", "tag": "96c4e0a9-d0ac-410f-958e-9547ccdceafa"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:50:07.749813 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-72ba4609-1ff8-46a9-8bb8-ca21e5b8c06a req-97b16651-2cf5-43dd-acf3-a47b03a4da87 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:07.750304 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-72ba4609-1ff8-46a9-8bb8-ca21e5b8c06a req-97b16651-2cf5-43dd-acf3-a47b03a4da87 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:07.750711 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-72ba4609-1ff8-46a9-8bb8-ca21e5b8c06a req-97b16651-2cf5-43dd-acf3-a47b03a4da87 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:07.761369 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-72ba4609-1ff8-46a9-8bb8-ca21e5b8c06a req-97b16651-2cf5-43dd-acf3-a47b03a4da87 service nova] Creating event network-vif-plugged:96c4e0a9-d0ac-410f-958e-9547ccdceafa for instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f on hv-cinder-85600 Sep 09 04:50:07.766378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-72ba4609-1ff8-46a9-8bb8-ca21e5b8c06a req-97b16651-2cf5-43dd-acf3-a47b03a4da87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154487 Sep 09 04:50:07.766967 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 509/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:50:08.500516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:08.501129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:08.507769 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:08.508256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:08.508693 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:08.509388 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:08.509846 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:08.510275 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:08.528504 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=100 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:50:08.564634 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:08.565992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:08.572383 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:08.572866 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:08.573303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:08.573992 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:08.574441 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:08.574862 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:08.578911 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:50:08.680545 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:08.689259 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7500a794-28d8-411b-b8ee-7a4afaefa7d5 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1265 microversion: 2.1 time: 0.192624 Sep 09 04:50:08.689837 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 514/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:08 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:08.729897 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:08.738157 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-46195596-8b6a-41ef-9d8e-36c4b946a9b2 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.178214 Sep 09 04:50:08.738738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 510/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:08 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:09.713048 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:09.713650 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:09.720030 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:09.720499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:09.720931 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:09.722253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:09.722703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:09.723157 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:09.760854 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:09.761467 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:09.767898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:09.768928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:09.769370 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:09.770104 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:09.770560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:09.771019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:09.901848 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:09.909447 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3e94eddf-cdae-4b80-b7fd-86b68a97b821 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1452 microversion: 2.1 time: 0.200228 Sep 09 04:50:09.910010 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 515/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:09 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:09.914369 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-5170e231-31ef-4cf6-8c78-f31200e6a57b req-ef26a605-b043-40dd-9ba4-ef814accd748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dce54f-84c2-4623-a137-e4337b192c67", "name": "network-vif-plugged", "status": "completed", "tag": "c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:50:09.923704 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-5170e231-31ef-4cf6-8c78-f31200e6a57b req-ef26a605-b043-40dd-9ba4-ef814accd748 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:09.924180 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-5170e231-31ef-4cf6-8c78-f31200e6a57b req-ef26a605-b043-40dd-9ba4-ef814accd748 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:09.924612 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-5170e231-31ef-4cf6-8c78-f31200e6a57b req-ef26a605-b043-40dd-9ba4-ef814accd748 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:09.932291 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:09.935544 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-5170e231-31ef-4cf6-8c78-f31200e6a57b req-ef26a605-b043-40dd-9ba4-ef814accd748 service nova] Creating event network-vif-plugged:c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4 for instance 54dce54f-84c2-4623-a137-e4337b192c67 on hv-cinder-85600 Sep 09 04:50:09.940547 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f37d5fbe-2a29-43e7-9b2a-dcc4ed376b34 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.182993 Sep 09 04:50:09.941117 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 511/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:09 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:50:09.941338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-5170e231-31ef-4cf6-8c78-f31200e6a57b req-ef26a605-b043-40dd-9ba4-ef814accd748 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030186 Sep 09 04:50:09.942053 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 516/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:50:09.945832 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:09.946432 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:09.952069 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:09.952571 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:09.953003 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:09.953702 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:09.954134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:09.954555 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:10.091356 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:10.099353 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-590bdec1-4c05-4470-b380-5a5566a109b1 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1452 microversion: 2.1 time: 0.157267 Sep 09 04:50:10.100011 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 512/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:09 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:10.966365 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:10.967056 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:10.974123 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:10.974707 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:10.975185 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:10.975932 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:10.976420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:10.976913 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:11.192804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:11.203749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-120d4401-780e-45ab-a355-5ae05b7c50fa tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1261 microversion: 2.1 time: 0.243434 Sep 09 04:50:11.204575 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 517/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:10 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:11.847611 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-36f1681b-6f30-4e98-a050-b32aaccb4750 req-03cce01f-cdd5-42ac-907d-2f177ee041b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47703db-953e-4fcb-8d5f-2cbcd4b7303f", "tag": "96c4e0a9-d0ac-410f-958e-9547ccdceafa"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:50:11.857018 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-36f1681b-6f30-4e98-a050-b32aaccb4750 req-03cce01f-cdd5-42ac-907d-2f177ee041b8 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:11.857489 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-36f1681b-6f30-4e98-a050-b32aaccb4750 req-03cce01f-cdd5-42ac-907d-2f177ee041b8 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:11.858098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-36f1681b-6f30-4e98-a050-b32aaccb4750 req-03cce01f-cdd5-42ac-907d-2f177ee041b8 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:11.869885 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-36f1681b-6f30-4e98-a050-b32aaccb4750 req-03cce01f-cdd5-42ac-907d-2f177ee041b8 service nova] Creating event network-changed:96c4e0a9-d0ac-410f-958e-9547ccdceafa for instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f on hv-cinder-85600 Sep 09 04:50:11.875485 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-36f1681b-6f30-4e98-a050-b32aaccb4750 req-03cce01f-cdd5-42ac-907d-2f177ee041b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099189 Sep 09 04:50:11.876074 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 513/1030] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:50:12.226989 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:12.227606 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:12.234018 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:12.234762 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:12.235395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:12.236279 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:12.237452 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:12.238056 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:12.377568 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:12.386811 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-aae315f0-7174-4c1c-b0ce-20672eba038f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1445 microversion: 2.1 time: 0.163315 Sep 09 04:50:12.395449 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 518/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:12 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:12.409488 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:50:12.411286 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:50:12.420378 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:12.420556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:12.420891 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:12.421591 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:12.422040 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:12.422457 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:12.562809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:50:12.572173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0d8c8f63-fb65-4ea9-b85b-135a708e8c53 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1445 microversion: 2.1 time: 0.167322 Sep 09 04:50:12.573075 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 514/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:50:12 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:50:14.569189 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-786a6452-83e4-49c7-ad14-2d4daee6d793 req-5aa2fac4-af01-48d6-85c5-b74345da510e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dce54f-84c2-4623-a137-e4337b192c67", "tag": "c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:50:14.579418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-786a6452-83e4-49c7-ad14-2d4daee6d793 req-5aa2fac4-af01-48d6-85c5-b74345da510e service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:50:14.579903 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-786a6452-83e4-49c7-ad14-2d4daee6d793 req-5aa2fac4-af01-48d6-85c5-b74345da510e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:50:14.580337 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-786a6452-83e4-49c7-ad14-2d4daee6d793 req-5aa2fac4-af01-48d6-85c5-b74345da510e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:50:14.592289 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-786a6452-83e4-49c7-ad14-2d4daee6d793 req-5aa2fac4-af01-48d6-85c5-b74345da510e service nova] Creating event network-changed:c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4 for instance 54dce54f-84c2-4623-a137-e4337b192c67 on hv-cinder-85600 Sep 09 04:50:14.598167 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-786a6452-83e4-49c7-ad14-2d4daee6d793 req-5aa2fac4-af01-48d6-85c5-b74345da510e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093589 Sep 09 04:50:14.598882 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 519/1033] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:51:58.710990 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:51:58.711738 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=24 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:51:58.713587 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 09 04:51:58.717593 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2128279546", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-488796557", "security_groups": [{"name": "tempest-secgroup-smoke-935715260"}], "block_device_mapping_v2": [{"uuid": "5ad72e98-7e05-4ddc-b006-355650fd7d30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8fb0b6b-bb8d-429d-b190-f0ae97f77f01"}]}} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:51:58.831263 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.network.neutron [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] validate_networks() for [('c8fb0b6b-bb8d-429d-b190-f0ae97f77f01', None, None, None, None, None)] {{(pid=127437) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 04:51:59.238184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Flavor limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 04:51:59.238586 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Image limits 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 04:51:59.239095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Flavor pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 04:51:59.239500 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Image pref 0:0:0 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 04:51:59.239905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.virt.hardware [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127437) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 04:51:59.249152 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:51:59.249632 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:51:59.250065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:51:59.250789 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:51:59.251269 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:51:59.251690 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:51:59.268095 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for project ea4c285aae544f47a91407ff79414128. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 04:51:59.271918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.quota [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Getting quotas for user 9ece0d7befa845c0ab2a33bfb10b7850 and project ea4c285aae544f47a91407ff79414128. Resources: {'instances', 'ram', 'cores'} {{(pid=127437) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 04:51:59.328056 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Going to run 1 instances... {{(pid=127437) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 04:51:59.330135 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ad72e98-7e05-4ddc-b006-355650fd7d30',volume_size=None,volume_type=None)] {{(pid=127437) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 04:51:59.458307 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a1254bba-4c65-4fd2-87bc-5f29646294ac tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749674 Sep 09 04:51:59.459128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 515/1034] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Sep 9 04:51:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 04:51:59.468778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0dcbaf93-2415-4a93-a2dd-a2bdafa5199b] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 09 04:51:59.469965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:51:59.470706 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=24 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:51:59.476921 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0bea4b00-c02a-4a09-8051-5823e43ef688 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:51:59.477632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0bea4b00-c02a-4a09-8051-5823e43ef688 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:51:59.536286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0bea4b00-c02a-4a09-8051-5823e43ef688 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:51:59.543746 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0bea4b00-c02a-4a09-8051-5823e43ef688 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1094 microversion: 2.1 time: 0.077291 Sep 09 04:51:59.544307 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 520/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:51:59 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:00.567675 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:00.568227 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:00.574569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:00.575166 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:00.575612 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:00.576315 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:00.576773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:00.577202 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:00.639712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:00.647544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b0cbe646-caed-4783-b4ca-59d9a0681d46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1192 microversion: 2.1 time: 0.084539 Sep 09 04:52:00.648665 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 516/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:00 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:01.672246 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:01.672974 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:01.685425 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:01.685918 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:01.686358 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:01.687257 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:01.687714 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:01.688141 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:01.708225 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO oslo.messaging._drivers.impl_rabbit [-] [0dcbaf93-2415-4a93-a2dd-a2bdafa5199b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52248. Sep 09 04:52:01.821022 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:01.829316 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-47756a3c-6743-418d-a507-fbe383d62748 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.161080 Sep 09 04:52:01.829892 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 521/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:01 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:02.107121 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-6b6fdba3-4529-4cc2-a2bb-692a924d20d8 req-59c3c1ef-3d97-44b4-8228-dcf645238e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46654d5-41df-4c10-9cda-9ea134527c63", "tag": "3c143aca-cc61-4ba0-87be-31348026acd3"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:52:02.117556 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-6b6fdba3-4529-4cc2-a2bb-692a924d20d8 req-59c3c1ef-3d97-44b4-8228-dcf645238e00 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:02.118089 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-6b6fdba3-4529-4cc2-a2bb-692a924d20d8 req-59c3c1ef-3d97-44b4-8228-dcf645238e00 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:02.118524 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-6b6fdba3-4529-4cc2-a2bb-692a924d20d8 req-59c3c1ef-3d97-44b4-8228-dcf645238e00 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:02.129878 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-6b6fdba3-4529-4cc2-a2bb-692a924d20d8 req-59c3c1ef-3d97-44b4-8228-dcf645238e00 service nova] Creating event network-changed:3c143aca-cc61-4ba0-87be-31348026acd3 for instance f46654d5-41df-4c10-9cda-9ea134527c63 on hv-cinder-85600 Sep 09 04:52:02.134718 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-6b6fdba3-4529-4cc2-a2bb-692a924d20d8 req-59c3c1ef-3d97-44b4-8228-dcf645238e00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031452 Sep 09 04:52:02.135351 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 517/1038] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:52:02.851626 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:02.852172 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:02.858741 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:02.859589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:02.860391 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:02.861648 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:02.862487 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:02.863328 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:03.002407 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:03.010226 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-9d63b0dd-cb56-440f-a8c1-46712c78b378 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.162671 Sep 09 04:52:03.010794 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 522/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:02 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:04.034256 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:04.034986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:04.041108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:04.041589 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:04.042025 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:04.042714 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:04.043196 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:04.043625 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:04.170220 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:04.178139 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-11e57474-a912-4f98-a26f-3d543bd92bab tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.149130 Sep 09 04:52:04.178712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 518/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:04 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:05.200818 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:05.201422 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:05.207799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:05.208277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:05.208710 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:05.209397 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:05.209847 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:05.210758 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:05.338101 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:05.345744 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7de2ece6-abd4-4b4e-bdcf-c4a8523e44ff tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.148778 Sep 09 04:52:05.346303 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 523/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:05 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:06.368761 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:06.369377 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:06.375796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:06.376276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:06.376810 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:06.377507 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:06.377959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:06.378418 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:06.510134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:06.517785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-004c745f-3072-4167-be1d-3a7c415116d8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.153650 Sep 09 04:52:06.518295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 519/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:06 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:07.541368 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:07.541949 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:07.548392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:07.548873 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:07.549311 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:07.550004 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:07.550461 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:07.550887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:07.678619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:07.686875 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3f1203a1-13e6-4c7d-a008-c80fe737178e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.149954 Sep 09 04:52:07.687458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 524/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:07 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:08.709569 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:08.710215 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:08.716566 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:08.717049 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:08.717488 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:08.718176 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:08.718629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:08.719084 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:08.851101 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:08.858770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-746ae4aa-b2d6-46ee-ad51-cc857011a55d tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.153035 Sep 09 04:52:08.859367 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 520/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:08 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:09.883288 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:09.883899 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:09.886220 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell0:SELECT=2 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:52:09.891682 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:09.892159 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:09.892591 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:09.893274 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:09.893755 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:09.894177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:10.021723 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:10.030167 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5508af4c-2aae-42a3-9d90-7b1f3922adc4 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.151254 Sep 09 04:52:10.030736 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 525/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:09 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:11.052983 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:11.053544 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:11.055431 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=2 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:52:11.056080 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell0:SELECT=6 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:52:11.062560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:11.063065 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:11.063499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:11.064183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:11.064629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:11.065056 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:11.194906 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:11.203108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f445c931-3c6e-4a56-8110-a703a2f21f46 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.154123 Sep 09 04:52:11.203685 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 521/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:11 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:11.823329 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:52:11.823892 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:11.830076 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:11.830551 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:11.831012 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:11.831703 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:11.832151 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:11.832574 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:11.857081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.objects.instance [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lazy-loading 'flavor' on Instance uuid 54dce54f-84c2-4623-a137-e4337b192c67 {{(pid=127436) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:52:11.931080 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-2da0348f-0306-4103-a1d1-d717b5ecf1ea tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "POST /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67/action" status: 202 len: 0 microversion: 2.1 time: 0.112376 Sep 09 04:52:11.931684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 526/1047] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:52:11 2022] POST /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:52:11.940042 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:11.940655 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:11.947921 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:11.948744 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:11.949305 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:11.950052 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:11.950501 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:11.951225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:12.092182 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:12.100421 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f47ce4bb-e9dd-492a-8b02-eb8a982e437d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.164111 Sep 09 04:52:12.101495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 522/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:11 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:12.126916 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-0d6d419d-454e-4a85-8947-4da40f5ee01c req-b13df135-880b-47d7-b995-74d75a7ff418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46654d5-41df-4c10-9cda-9ea134527c63", "name": "network-vif-plugged", "status": "completed", "tag": "3c143aca-cc61-4ba0-87be-31348026acd3"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:52:12.136965 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-0d6d419d-454e-4a85-8947-4da40f5ee01c req-b13df135-880b-47d7-b995-74d75a7ff418 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:12.137470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-0d6d419d-454e-4a85-8947-4da40f5ee01c req-b13df135-880b-47d7-b995-74d75a7ff418 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:12.137888 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-0d6d419d-454e-4a85-8947-4da40f5ee01c req-b13df135-880b-47d7-b995-74d75a7ff418 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:12.151476 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-0d6d419d-454e-4a85-8947-4da40f5ee01c req-b13df135-880b-47d7-b995-74d75a7ff418 service nova] Creating event network-vif-plugged:3c143aca-cc61-4ba0-87be-31348026acd3 for instance f46654d5-41df-4c10-9cda-9ea134527c63 on hv-cinder-85600 Sep 09 04:52:12.156277 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-0d6d419d-454e-4a85-8947-4da40f5ee01c req-b13df135-880b-47d7-b995-74d75a7ff418 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Sep 09 04:52:12.156873 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 527/1049] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:52:12.226231 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:12.227128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:12.233901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:12.234395 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:12.234835 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:12.236201 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:12.236658 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:12.237091 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:12.373389 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:12.381212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0ee3d500-ffdd-4836-a085-10a72c03e6c8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.159575 Sep 09 04:52:12.382179 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 523/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:12 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:13.125462 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:13.126085 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:13.132717 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:13.133199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:13.133633 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:13.134334 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:13.134785 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:13.135234 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:13.271862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:13.279950 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0c41d008-ebea-4ba3-b66b-f03fe9655949 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.159551 Sep 09 04:52:13.280516 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 528/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:13 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:13.404207 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:13.404825 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:13.411197 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:13.411679 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:13.412115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:13.412800 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:13.413257 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:13.413678 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:13.546713 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:13.555027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-b7483e03-96be-4de4-b2da-701a0ff9e56e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1265 microversion: 2.1 time: 0.154708 Sep 09 04:52:13.555594 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 524/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:13 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:14.303256 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:14.303857 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:14.310295 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:14.311133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:14.311275 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:14.312037 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:14.312423 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:14.312873 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:14.445674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:14.453327 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8166dcc9-a870-46db-8de3-876daad4d449 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.154057 Sep 09 04:52:14.453889 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 529/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:14 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:14.577843 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:14.578386 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:14.585677 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:14.586526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:14.587078 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:14.587805 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:14.588264 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:14.588694 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:14.732551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:14.740423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-483e165b-bf7e-4381-bc21-c5d8b9048caa tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1452 microversion: 2.1 time: 0.166648 Sep 09 04:52:14.740997 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 525/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:14 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:14.763304 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:14.763915 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:14.769834 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:14.770318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:14.770755 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:14.771481 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:14.771936 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:14.772370 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:14.900420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:14.908260 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fc5a4b4b-64d8-44e6-a1c3-7efed1f2b1e2 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1452 microversion: 2.1 time: 0.148743 Sep 09 04:52:14.908841 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 530/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:14 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:15.478248 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:15.478858 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:15.484770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:15.485184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:15.485615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:15.486300 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:15.486746 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:15.487303 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:15.660693 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:15.670466 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a70aa6f0-fc06-4c35-904d-cc795285486b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.196734 Sep 09 04:52:15.671074 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 526/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:15 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:16.693798 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:16.694403 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:16.700851 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:16.701335 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:16.701768 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:16.702458 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:16.702906 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:16.703356 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:16.904520 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:16.911380 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-d4d1f0c8-44e1-4c94-8c14-d5d8f016e89f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.221708 Sep 09 04:52:16.911959 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 531/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:16 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:16.912383 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-aa7556fc-ab79-4d0c-b1ed-6c2501201c70 req-2a091bfb-09a1-43bf-9be8-2fcd21fe1d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46654d5-41df-4c10-9cda-9ea134527c63", "tag": "3c143aca-cc61-4ba0-87be-31348026acd3"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:52:16.922759 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-aa7556fc-ab79-4d0c-b1ed-6c2501201c70 req-2a091bfb-09a1-43bf-9be8-2fcd21fe1d8b service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:16.923212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-aa7556fc-ab79-4d0c-b1ed-6c2501201c70 req-2a091bfb-09a1-43bf-9be8-2fcd21fe1d8b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:16.923840 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-aa7556fc-ab79-4d0c-b1ed-6c2501201c70 req-2a091bfb-09a1-43bf-9be8-2fcd21fe1d8b service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:16.936977 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-aa7556fc-ab79-4d0c-b1ed-6c2501201c70 req-2a091bfb-09a1-43bf-9be8-2fcd21fe1d8b service nova] Creating event network-changed:3c143aca-cc61-4ba0-87be-31348026acd3 for instance f46654d5-41df-4c10-9cda-9ea134527c63 on hv-cinder-85600 Sep 09 04:52:16.941932 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-aa7556fc-ab79-4d0c-b1ed-6c2501201c70 req-2a091bfb-09a1-43bf-9be8-2fcd21fe1d8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033141 Sep 09 04:52:16.942515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 527/1058] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 04:52:17.935265 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:17.935879 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:17.942820 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:17.943344 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:17.944038 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:17.945384 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:17.945838 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:17.946266 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:18.100264 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:18.109581 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-7f23149c-186a-4146-919b-f0f2ba57e567 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.178256 Sep 09 04:52:18.119383 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 532/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:17 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:19.134961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:19.135597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:19.141729 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:19.142212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:19.142648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:19.143364 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:19.143818 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:19.144250 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:19.274252 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:19.283134 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-13315d7e-6bfc-4954-88c0-8d5352f9314c tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.153648 Sep 09 04:52:19.283697 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 528/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:19 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:20.305799 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:20.306419 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:20.312900 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:20.313381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:20.313814 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:20.314499 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:20.314968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:20.315395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:20.450297 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:20.458431 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a829fc38-c3a3-40ed-a98a-ef892d6ddd85 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.156564 Sep 09 04:52:20.458995 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 533/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:20 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:21.482515 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:21.483093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:21.489553 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:21.490026 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:21.490455 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:21.491475 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:21.491929 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:21.492348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:21.620440 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:21.628424 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-e979d5df-eecd-4076-931d-c39dc02516f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.149856 Sep 09 04:52:21.629027 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 529/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:21 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:22.651651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:22.652281 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:22.658781 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:22.659302 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:22.659740 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:22.660434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:22.660887 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:22.661313 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:22.792987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:22.800617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-8397a294-e720-438b-b80b-0ab3dca149dd tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.152928 Sep 09 04:52:22.801181 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 534/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:22 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:23.824163 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:23.824770 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:23.831173 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:23.831648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:23.832108 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:23.832787 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:23.833234 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:23.833653 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:23.964536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:23.976945 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6710f7cc-4224-481f-a7fb-5f94e601f17f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.156269 Sep 09 04:52:23.982737 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 530/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:23 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:25.003435 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:25.004031 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:25.010470 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:25.010982 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:25.011427 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:25.012123 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:25.012574 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:25.012996 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:25.144617 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:25.153488 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-97625ee6-3ef2-449d-8815-9af99523f78b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1571 microversion: 2.1 time: 0.153888 Sep 09 04:52:25.154057 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 535/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:24 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:25.176341 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:52:25.176936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:25.183306 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:25.183786 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:25.184218 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:25.184899 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:25.185343 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:25.185762 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:25.227354 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127437) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 04:52:25.292366 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f148259f-71dc-47e9-8713-92189c93b44e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "POST /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67/action" status: 202 len: 0 microversion: 2.1 time: 0.119825 Sep 09 04:52:25.293039 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 531/1066] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Sep 9 04:52:25 2022] POST /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:52:25.301191 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:25.301805 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:25.308616 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:25.309176 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:25.309620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:25.310318 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:25.310771 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:25.311227 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:25.315600 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:52:25.479500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:25.487357 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a209792c-76d1-4ab9-8267-78bff2cd8535 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1579 microversion: 2.1 time: 0.190008 Sep 09 04:52:25.488114 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 536/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:25 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1579 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:26.511103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:26.511745 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:26.518605 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:26.519313 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:26.519470 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:26.520163 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:26.520609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:26.521031 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:26.539331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:52:26.662898 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:26.671639 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-bba875f3-7060-41be-b8ef-c28bed954fb7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1519 microversion: 2.1 time: 0.164946 Sep 09 04:52:26.672221 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 532/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:26 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:27.695418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:27.696179 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:27.702595 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:27.703115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:27.703563 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:27.704259 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:27.704742 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:27.705167 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:27.842150 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:27.849922 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-740862dd-f2b0-48b3-b996-ee171132fba6 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1519 microversion: 2.1 time: 0.159743 Sep 09 04:52:27.850477 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 537/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:27 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:28.126579 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-90bc3168-3eee-4229-b29d-3f857e6ca750 req-a677cd25-6552-4849-8081-57b1cc3deb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dce54f-84c2-4623-a137-e4337b192c67", "name": "network-vif-unplugged", "status": "completed", "tag": "c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:52:28.137090 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-90bc3168-3eee-4229-b29d-3f857e6ca750 req-a677cd25-6552-4849-8081-57b1cc3deb72 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:28.137570 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-90bc3168-3eee-4229-b29d-3f857e6ca750 req-a677cd25-6552-4849-8081-57b1cc3deb72 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:28.137993 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-90bc3168-3eee-4229-b29d-3f857e6ca750 req-a677cd25-6552-4849-8081-57b1cc3deb72 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:28.149608 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.compute.server_external_events [req-90bc3168-3eee-4229-b29d-3f857e6ca750 req-a677cd25-6552-4849-8081-57b1cc3deb72 service nova] Unable to find a host for instance 54dce54f-84c2-4623-a137-e4337b192c67. Dropping event network-vif-unplugged {{(pid=127437) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 04:52:28.150482 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-90bc3168-3eee-4229-b29d-3f857e6ca750 req-a677cd25-6552-4849-8081-57b1cc3deb72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027936 Sep 09 04:52:28.151098 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 533/1070] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 09 04:52:28.873870 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:28.874266 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:28.880689 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:28.881170 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:28.881602 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:28.882971 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:28.883431 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:28.883863 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:29.015790 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:29.024017 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-3030b2ae-ffdf-4735-901e-97f0ce70c7d8 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.154406 Sep 09 04:52:29.024585 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 538/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:28 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:30.046976 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:30.047543 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:30.049851 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:52:30.055044 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:30.055526 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:30.055963 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:30.056651 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:30.057103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:30.057535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:30.191325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:30.199706 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-0ae15b9e-447a-4ed8-9bdd-defc040464a7 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.156687 Sep 09 04:52:30.200276 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 534/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:30 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:31.224003 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:31.224651 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:31.228711 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=41 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:52:31.233095 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:31.233584 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:31.234024 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:31.234727 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:31.235497 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:31.235841 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:31.364901 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:31.372528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-da80a40e-6bda-4d75-9c55-e3b3567191a5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.153243 Sep 09 04:52:31.373091 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 539/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:31 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:32.395629 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:32.396162 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:32.402249 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:32.402733 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:32.403200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:32.403901 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:32.404353 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:32.404777 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:32.530877 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:32.539200 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a7805452-d676-4d25-8897-e9b2fa45fd0b tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.147583 Sep 09 04:52:32.539766 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 535/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:32 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:33.562959 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:33.563500 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:33.570271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:33.570747 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:33.571202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:33.571884 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:33.572338 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:33.572757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:33.702467 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:33.710130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-5b982d37-cad7-4448-8bcf-5cbe22aa0e7f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.151316 Sep 09 04:52:33.710693 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 540/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:33 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:34.732999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:34.733595 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:34.739928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:34.740410 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:34.740846 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:34.741535 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:34.741986 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:34.742409 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:34.869990 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:34.877648 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-264db6fd-1530-4a1f-be99-890c68659323 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.148597 Sep 09 04:52:34.878230 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 536/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:34 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:35.902020 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:35.902630 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:35.909086 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:35.909571 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:35.910007 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:35.910702 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:35.911208 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:35.911620 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:36.043573 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:36.051235 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-65086072-bdea-4f19-af05-0adaf746ac2d tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.153651 Sep 09 04:52:36.051812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 541/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:35 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:37.075769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:37.076578 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:37.082999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:37.083486 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:37.083926 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:37.084619 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:37.085071 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:37.085495 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:37.213784 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:37.221536 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-435d4aaa-cbe4-4d1b-a9b4-1a21a6420b09 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.149739 Sep 09 04:52:37.222109 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 537/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:37 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:52:38.246646 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:38.247420 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:38.253773 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:38.254253 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:38.254685 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:38.255453 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:38.255907 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:38.256360 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:38.391347 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:38.398961 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-33fe25d3-a905-4a17-8115-0f3dfcbcf3d5 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.156828 Sep 09 04:52:38.399528 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 542/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:38 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:39.422093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:39.422683 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:39.429101 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:39.430068 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:39.430500 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:39.431211 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:39.431661 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:39.432111 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:39.563936 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:39.572769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6815c920-5efa-4232-804b-7279c13efd7a tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.154536 Sep 09 04:52:39.573361 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 538/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:39 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:40.216248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-d66f80f2-a115-4954-a380-9415a42ed0d0 req-02397312-5a5a-44db-ad9c-60b5ee9ec3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dce54f-84c2-4623-a137-e4337b192c67", "name": "network-vif-plugged", "status": "completed", "tag": "c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:52:40.227354 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d66f80f2-a115-4954-a380-9415a42ed0d0 req-02397312-5a5a-44db-ad9c-60b5ee9ec3cb service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:40.227890 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d66f80f2-a115-4954-a380-9415a42ed0d0 req-02397312-5a5a-44db-ad9c-60b5ee9ec3cb service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:40.228323 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-d66f80f2-a115-4954-a380-9415a42ed0d0 req-02397312-5a5a-44db-ad9c-60b5ee9ec3cb service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:40.239917 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-d66f80f2-a115-4954-a380-9415a42ed0d0 req-02397312-5a5a-44db-ad9c-60b5ee9ec3cb service nova] Creating event network-vif-plugged:c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4 for instance 54dce54f-84c2-4623-a137-e4337b192c67 on hv-cinder-85600 Sep 09 04:52:40.244829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-d66f80f2-a115-4954-a380-9415a42ed0d0 req-02397312-5a5a-44db-ad9c-60b5ee9ec3cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Sep 09 04:52:40.245519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 543/1081] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:52:40.595587 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:40.596198 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:40.602499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:40.603009 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:40.603449 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:40.604140 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:40.604598 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:40.605019 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:40.733113 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:40.740769 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-6feb5d05-c03c-4052-915c-d4fd149d6f1f tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.149078 Sep 09 04:52:40.741331 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 539/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:40 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:41.764866 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:41.765557 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:41.771701 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:41.772186 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:41.772615 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:41.773804 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:41.774249 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:41.774666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:41.905782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:41.914392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-f69e3793-79e8-48c9-b640-0422ad06a173 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1577 microversion: 2.1 time: 0.153683 Sep 09 04:52:41.914987 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 544/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:41 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:52:42.937172 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:52:42.937785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:52:42.944499 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:42.944976 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:42.945408 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:42.946097 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:52:42.946546 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:52:42.946999 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:52:43.074740 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:52:43.082398 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-097ba590-4e13-4f38-961b-aefd7f15a118 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1564 microversion: 2.1 time: 0.149096 Sep 09 04:52:43.082981 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 540/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:52:42 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:45.004229 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_api:SELECT=11 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:53:45.005764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG dbcounter [-] [127436] Writing DB stats nova_cell1:SELECT=48 {{(pid=127436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:53:45.006793 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 04:53:45.007141 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Fri Sep 9 04:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 (ip 10.222.0.20) !!! Sep 09 04:53:45.007922 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_api:SELECT=13 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:53:45.008757 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG dbcounter [-] [127437] Writing DB stats nova_cell1:SELECT=46 {{(pid=127437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 04:53:45.009129 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 04:53:45.009295 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Fri Sep 9 04:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 (ip 10.222.0.20) !!! Sep 09 04:53:45.012747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 04:53:45.012949 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Fri Sep 9 04:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 09 04:53:45.015726 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:45.016895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:45.024690 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-43fa0319-b26c-4113-9b2a-7181459995cb req-51c54483-5213-486e-8694-065635ef2fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46654d5-41df-4c10-9cda-9ea134527c63", "tag": "3c143aca-cc61-4ba0-87be-31348026acd3"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:53:45.036232 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:45.036725 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:45.037162 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:45.038549 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:45.039421 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:45.040212 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:45.044423 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-43fa0319-b26c-4113-9b2a-7181459995cb req-51c54483-5213-486e-8694-065635ef2fb2 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:45.045695 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-43fa0319-b26c-4113-9b2a-7181459995cb req-51c54483-5213-486e-8694-065635ef2fb2 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:45.046349 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-43fa0319-b26c-4113-9b2a-7181459995cb req-51c54483-5213-486e-8694-065635ef2fb2 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:45.066626 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-43fa0319-b26c-4113-9b2a-7181459995cb req-51c54483-5213-486e-8694-065635ef2fb2 service nova] Creating event network-changed:3c143aca-cc61-4ba0-87be-31348026acd3 for instance f46654d5-41df-4c10-9cda-9ea134527c63 on hv-cinder-85600 Sep 09 04:53:45.073081 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Going to try to terminate instance {{(pid=127436) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:53:45.075438 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-43fa0319-b26c-4113-9b2a-7181459995cb req-51c54483-5213-486e-8694-065635ef2fb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069520 Sep 09 04:53:45.076348 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 541/1085] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:53:45.153782 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-0ffb49c0-ca2e-4060-ab25-d3862430f506 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 204 len: 0 microversion: 2.1 time: 0.150903 Sep 09 04:53:45.155199 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 545/1086] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:53:45 2022] DELETE /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:53:45.165917 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:45.166907 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:45.175889 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:45.176399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:45.177093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:45.177961 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:45.178765 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:45.179941 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:45.321404 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:45.329297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-f2c741e8-f806-4f68-91cd-8763094e0d9e tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1577 microversion: 2.1 time: 0.169537 Sep 09 04:53:45.329965 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 542/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:45 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 04:53:46.356939 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:46.357666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:46.364206 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:46.364684 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:46.365116 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:46.365829 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:46.366280 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:46.366700 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:46.494619 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:46.502349 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-e207625f-59bd-4b7e-83ea-d69d8c38fd51 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1577 microversion: 2.1 time: 0.149626 Sep 09 04:53:46.502909 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 546/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:46 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:47.526417 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:47.527093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:47.533393 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:47.533887 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:47.534325 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:47.535059 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:47.535518 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:47.535943 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:47.667409 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:47.675184 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-600933d4-fb6e-43ab-bd6b-dd155e749256 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1577 microversion: 2.1 time: 0.153410 Sep 09 04:53:47.675753 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 543/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:47 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:47.950286 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-e5a37cc3-9eb9-45ba-954c-5f86bedaedc7 req-0aeb913b-dedd-428a-a837-ab91c9e8d792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46654d5-41df-4c10-9cda-9ea134527c63", "name": "network-vif-deleted", "tag": "3c143aca-cc61-4ba0-87be-31348026acd3"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:53:47.962726 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-e5a37cc3-9eb9-45ba-954c-5f86bedaedc7 req-0aeb913b-dedd-428a-a837-ab91c9e8d792 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:47.963229 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-e5a37cc3-9eb9-45ba-954c-5f86bedaedc7 req-0aeb913b-dedd-428a-a837-ab91c9e8d792 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:47.963657 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-e5a37cc3-9eb9-45ba-954c-5f86bedaedc7 req-0aeb913b-dedd-428a-a837-ab91c9e8d792 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:47.975415 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-e5a37cc3-9eb9-45ba-954c-5f86bedaedc7 req-0aeb913b-dedd-428a-a837-ab91c9e8d792 service nova] Creating event network-vif-deleted:3c143aca-cc61-4ba0-87be-31348026acd3 for instance f46654d5-41df-4c10-9cda-9ea134527c63 on hv-cinder-85600 Sep 09 04:53:47.981968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-e5a37cc3-9eb9-45ba-954c-5f86bedaedc7 req-0aeb913b-dedd-428a-a837-ab91c9e8d792 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Sep 09 04:53:47.983453 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 547/1090] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:53:48.698924 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:48.699639 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:48.706128 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:48.706615 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:48.707093 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:48.707785 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:48.708238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:48.708667 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:48.738295 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:48.738773 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:48.739243 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:48.739686 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lazy-loading 'fault' on Instance uuid f46654d5-41df-4c10-9cda-9ea134527c63 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:53:48.779880 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:48.787551 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-cc589e97-0d51-4ad7-b6d5-e046bd39eba7 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 200 len: 1230 microversion: 2.1 time: 0.093912 Sep 09 04:53:48.788126 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 544/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:48 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:49.811506 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:49.812202 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: f46654d5-41df-4c10-9cda-9ea134527c63] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:49.818740 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:49.819511 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:49.819952 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:49.820645 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:49.821133 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:49.821561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:49.834596 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] HTTP exception thrown: Instance f46654d5-41df-4c10-9cda-9ea134527c63 could not be found. Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Request method failure captured: Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 HTTP/1.1 Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsU1N94QspC1-0zmzgvR8JcQTNrzmEgcZ2u7YHbgoZPI8q2dJH2E9sCUKGXqKe8tBS6OFdfr-CMsNePdat7HL3_AVbvv9BqAmNbkpuhecIYFgwb4ja6sHiGJhnXBf0HVyb3ctNl19qtkPYUIcnJmTdxaT2sU90q4cx9lIMhS3k_Hkyw Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:53:49.836224 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ea4c285aae544f47a91407ff79414128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ea4c285aae544f47a91407ff79414128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}] Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 9ece0d7befa845c0ab2a33bfb10b7850 Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance f46654d5-41df-4c10-9cda-9ea134527c63 could not be found. Sep 09 04:53:49.837967 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'f46654d5-41df-4c10-9cda-9ea134527c63'} Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46654d5-41df-4c10-9cda-9ea134527c63 could not be found. Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:53:49.839778 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46654d5-41df-4c10-9cda-9ea134527c63 could not be found. Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46654d5-41df-4c10-9cda-9ea134527c63 could not be found. Sep 09 04:53:49.841482 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:49.842980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Returning 404 to user: Instance f46654d5-41df-4c10-9cda-9ea134527c63 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:53:49.842980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-6cb2aa76-5498-4735-ad01-00ecdf246464 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63" status: 404 len: 111 microversion: 2.1 time: 0.030451 Sep 09 04:53:49.842980 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 548/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:49 2022] GET /compute/v2.1/servers/f46654d5-41df-4c10-9cda-9ea134527c63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:53:52.877292 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:52.877830 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:52.879578 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-51855554-c408-4cd9-8b0d-8f5cb69a8684 req-81dd3107-e26c-4d45-8302-3c14884598b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47703db-953e-4fcb-8d5f-2cbcd4b7303f", "tag": "96c4e0a9-d0ac-410f-958e-9547ccdceafa"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:53:52.884269 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:52.884747 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:52.885183 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:52.886115 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:52.886563 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:52.887212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:52.890498 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-51855554-c408-4cd9-8b0d-8f5cb69a8684 req-81dd3107-e26c-4d45-8302-3c14884598b1 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:52.891248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-51855554-c408-4cd9-8b0d-8f5cb69a8684 req-81dd3107-e26c-4d45-8302-3c14884598b1 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:52.891895 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-51855554-c408-4cd9-8b0d-8f5cb69a8684 req-81dd3107-e26c-4d45-8302-3c14884598b1 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:52.906589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-51855554-c408-4cd9-8b0d-8f5cb69a8684 req-81dd3107-e26c-4d45-8302-3c14884598b1 service nova] Creating event network-changed:96c4e0a9-d0ac-410f-958e-9547ccdceafa for instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f on hv-cinder-85600 Sep 09 04:53:52.912207 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-51855554-c408-4cd9-8b0d-8f5cb69a8684 req-81dd3107-e26c-4d45-8302-3c14884598b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036461 Sep 09 04:53:52.913580 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 549/1093] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:53:52.914005 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:53:52.999133 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-4fcee286-dafd-4843-b023-376e5a6fbd75 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 204 len: 0 microversion: 2.1 time: 0.124961 Sep 09 04:53:52.999426 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 545/1094] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:53:52 2022] DELETE /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:53:53.010666 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:53.011392 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:53.029560 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:53.030410 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:53.031713 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:53.032652 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:53.033319 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:53.034140 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:53.164803 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:53.172674 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-de870085-915f-48f5-b056-ad4ec959f3a0 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1576 microversion: 2.1 time: 0.166785 Sep 09 04:53:53.173243 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 550/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:53 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:54.197609 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:54.198312 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:54.204764 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:54.205251 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:54.205690 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:54.206385 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:54.206837 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:54.207289 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:54.340087 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:54.347817 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d8b08e3b-0299-4cad-9429-98f4d0b5b422 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1576 microversion: 2.1 time: 0.155315 Sep 09 04:53:54.348389 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 546/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:54 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:55.371690 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:55.372296 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:55.379049 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:55.379542 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:55.379978 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:55.380680 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:55.381145 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:55.381561 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:55.452131 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ece0d7befa845c0ab2a33bfb10b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea4c285aae544f47a91407ff79414128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:55.460102 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-065f4500-c285-4d63-a5cd-3c62e0e4084b tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 200 len: 1391 microversion: 2.1 time: 0.092325 Sep 09 04:53:55.460675 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 551/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:55 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 1391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:55.488928 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [req-f35c20ab-41c0-4fc9-b3c0-ad667c316cd4 req-298fafb3-aa45-4898-a780-7fcd16a89b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47703db-953e-4fcb-8d5f-2cbcd4b7303f", "name": "network-vif-deleted", "tag": "96c4e0a9-d0ac-410f-958e-9547ccdceafa"}]} {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:53:55.499534 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f35c20ab-41c0-4fc9-b3c0-ad667c316cd4 req-298fafb3-aa45-4898-a780-7fcd16a89b3e service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:55.500006 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f35c20ab-41c0-4fc9-b3c0-ad667c316cd4 req-298fafb3-aa45-4898-a780-7fcd16a89b3e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:55.500432 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [req-f35c20ab-41c0-4fc9-b3c0-ad667c316cd4 req-298fafb3-aa45-4898-a780-7fcd16a89b3e service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:55.512035 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.compute.server_external_events [req-f35c20ab-41c0-4fc9-b3c0-ad667c316cd4 req-298fafb3-aa45-4898-a780-7fcd16a89b3e service nova] Creating event network-vif-deleted:96c4e0a9-d0ac-410f-958e-9547ccdceafa for instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f on hv-cinder-85600 Sep 09 04:53:55.516959 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [req-f35c20ab-41c0-4fc9-b3c0-ad667c316cd4 req-298fafb3-aa45-4898-a780-7fcd16a89b3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031847 Sep 09 04:53:55.517560 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 547/1098] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:53:56.485072 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:56.485671 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: b47703db-953e-4fcb-8d5f-2cbcd4b7303f] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:56.492135 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:56.492622 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:56.493060 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:56.493757 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:56.494382 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:56.494812 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:56.509972 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] HTTP exception thrown: Instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f could not be found. Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Request method failure captured: Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f HTTP/1.1 Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsU1N94QspC1-0zmzgvR8JcQTNrzmEgcZ2u7YHbgoZPI8q2dJH2E9sCUKGXqKe8tBS6OFdfr-CMsNePdat7HL3_AVbvv9BqAmNbkpuhecIYFgwb4ja6sHiGJhnXBf0HVyb3ctNl19qtkPYUIcnJmTdxaT2sU90q4cx9lIMhS3k_Hkyw Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:53:56.511687 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ea4c285aae544f47a91407ff79414128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ea4c285aae544f47a91407ff79414128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}] Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 9ece0d7befa845c0ab2a33bfb10b7850 Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f could not be found. Sep 09 04:53:56.513492 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'b47703db-953e-4fcb-8d5f-2cbcd4b7303f'} Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f could not be found. Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:53:56.514519 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f could not be found. Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f could not be found. Sep 09 04:53:56.516271 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.517767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Returning 404 to user: Instance b47703db-953e-4fcb-8d5f-2cbcd4b7303f could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:53:56.517767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-75559667-2798-4629-b8c9-237261780460 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f" status: 404 len: 111 microversion: 2.1 time: 0.032005 Sep 09 04:53:56.517767 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 552/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:56 2022] GET /compute/v2.1/servers/b47703db-953e-4fcb-8d5f-2cbcd4b7303f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:53:56.953212 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:56.953801 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:56.959893 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:56.960374 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:56.960809 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:56.961525 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:56.961977 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:56.962399 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:56.975301 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.wsgi [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] HTTP exception thrown: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Request method failure captured: Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: request: DELETE /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 HTTP/1.1 Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept: application/json Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Accept-Encoding: identity Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Connection: close Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Length: 0 Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Content-Type: application/json Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Host: 10.222.0.20 Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: Openstack-System-Scope: None Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: User-Agent: python-urllib3/1.26.12 Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Auth-Token: gAAAAABjGsU1N94QspC1-0zmzgvR8JcQTNrzmEgcZ2u7YHbgoZPI8q2dJH2E9sCUKGXqKe8tBS6OFdfr-CMsNePdat7HL3_AVbvv9BqAmNbkpuhecIYFgwb4ja6sHiGJhnXBf0HVyb3ctNl19qtkPYUIcnJmTdxaT2sU90q4cx9lIMhS3k_Hkyw Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Id: None Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Domain-Name: None Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Identity-Status: Confirmed Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Is-Admin-Project: True Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Id: default Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Domain-Name: Default Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Project-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Role: reader,member Sep 09 04:53:56.976918 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Roles: reader,member Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ea4c285aae544f47a91407ff79414128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ea4c285aae544f47a91407ff79414128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}] Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-Tenant-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Id: default Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Domain-Name: Default Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Id: 9ece0d7befa845c0ab2a33bfb10b7850 Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: X-User-Name: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: method: > Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: exception: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:56.979597 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: action_args: {'id': 'c35f607e-1028-4a37-8027-e86b1a8a9875'} Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:53:56.980755 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:56.983103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: ERROR nova.api.openstack.wsgi Sep 09 04:53:56.984886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Returning 404 to user: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. {{(pid=127437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:53:56.984886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-a153b660-1d38-4341-9ee7-eb6c8426cd25 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 404 len: 111 microversion: 2.1 time: 0.029739 Sep 09 04:53:56.984886 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 548/1100] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:53:56 2022] DELETE /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:53:56.986783 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:56.987466 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] [instance: c35f607e-1028-4a37-8027-e86b1a8a9875] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:56.994219 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:56.994736 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:56.995261 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:56.995975 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:56.996434 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:56.996862 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:57.010825 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] HTTP exception thrown: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Request method failure captured: Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 HTTP/1.1 Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsU1N94QspC1-0zmzgvR8JcQTNrzmEgcZ2u7YHbgoZPI8q2dJH2E9sCUKGXqKe8tBS6OFdfr-CMsNePdat7HL3_AVbvv9BqAmNbkpuhecIYFgwb4ja6sHiGJhnXBf0HVyb3ctNl19qtkPYUIcnJmTdxaT2sU90q4cx9lIMhS3k_Hkyw Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:53:57.012376 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ea4c285aae544f47a91407ff79414128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ea4c285aae544f47a91407ff79414128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ea4c285aae544f47a91407ff79414128"}]}] Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: ea4c285aae544f47a91407ff79414128 Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-TestVolumeBootPattern-241937363 Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: 9ece0d7befa845c0ab2a33bfb10b7850 Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-TestVolumeBootPattern-241937363-project Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:57.014112 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': 'c35f607e-1028-4a37-8027-e86b1a8a9875'} Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:53:57.015130 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. Sep 09 04:53:57.016766 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:53:57.018174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Returning 404 to user: Instance c35f607e-1028-4a37-8027-e86b1a8a9875 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:53:57.018174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-a772d234-e824-46d7-94aa-21a4ae34f9e8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875" status: 404 len: 111 microversion: 2.1 time: 0.030783 Sep 09 04:53:57.018174 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 553/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:56 2022] GET /compute/v2.1/servers/c35f607e-1028-4a37-8027-e86b1a8a9875 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:53:57.911951 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:57.912796 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:57.913847 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-bf7e4024-e7bd-4cf3-8bb0-eac18c9ef664 req-9b9f2d4b-e769-4601-8b77-0fff9b434e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dce54f-84c2-4623-a137-e4337b192c67", "tag": "c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:53:57.919507 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:57.920070 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:57.920570 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:57.921268 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:57.921905 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:57.922328 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:57.925363 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bf7e4024-e7bd-4cf3-8bb0-eac18c9ef664 req-9b9f2d4b-e769-4601-8b77-0fff9b434e77 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:57.925968 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bf7e4024-e7bd-4cf3-8bb0-eac18c9ef664 req-9b9f2d4b-e769-4601-8b77-0fff9b434e77 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:57.926662 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-bf7e4024-e7bd-4cf3-8bb0-eac18c9ef664 req-9b9f2d4b-e769-4601-8b77-0fff9b434e77 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:57.938284 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-bf7e4024-e7bd-4cf3-8bb0-eac18c9ef664 req-9b9f2d4b-e769-4601-8b77-0fff9b434e77 service nova] Creating event network-changed:c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4 for instance 54dce54f-84c2-4623-a137-e4337b192c67 on hv-cinder-85600 Sep 09 04:53:57.944032 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-bf7e4024-e7bd-4cf3-8bb0-eac18c9ef664 req-9b9f2d4b-e769-4601-8b77-0fff9b434e77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033982 Sep 09 04:53:57.945581 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 554/1102] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:53:57.952723 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Going to try to terminate instance {{(pid=127437) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 04:53:58.047103 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-9df49918-78ef-420d-a4f8-14913832b651 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 204 len: 0 microversion: 2.1 time: 0.139103 Sep 09 04:53:58.048712 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 549/1103] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Sep 9 04:53:57 2022] DELETE /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 04:53:58.057115 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:58.058065 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:58.064740 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:58.065229 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:58.065697 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:58.066594 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:58.067086 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:58.067518 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:58.256428 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:58.269381 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-fa7bb491-e018-468b-8d5c-b12a739d6caf tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.216461 Sep 09 04:53:58.270177 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 555/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:58 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:53:58.363944 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-8dec90e8-4cc1-4179-bf9d-6bd2a7d1efc8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] Calling method '.version_select at 0x7f43fad3a9d0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:58.388474 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-8dec90e8-4cc1-4179-bf9d-6bd2a7d1efc8 tempest-TestVolumeBootPattern-241937363 tempest-TestVolumeBootPattern-241937363-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-488796557" status: 202 len: 0 microversion: 2.1 time: 0.029406 Sep 09 04:53:58.392943 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 550/1105] 10.222.0.20 () {58 vars in 1260 bytes} [Fri Sep 9 04:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-488796557 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 04:53:59.296957 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:53:59.297538 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:53:59.303937 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:59.304418 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:59.305003 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:59.305695 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:53:59.306143 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:53:59.306564 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:53:59.509194 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.policy [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127436) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:53:59.516886 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-cae90614-8843-4237-92a5-90f2886d80ec tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.223771 Sep 09 04:53:59.517395 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 556/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:53:59 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:54:00.541990 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:54:00.543494 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:54:00.552030 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:00.552827 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:00.553506 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:00.554450 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:00.555265 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:00.555984 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:00.876083 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:54:00.885682 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-3ad619fd-1b36-4810-905f-643fc1ded7f3 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1570 microversion: 2.1 time: 0.347722 Sep 09 04:54:00.886493 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 551/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:54:00 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1570 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:54:00.918248 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [req-2f8a59da-5adb-41eb-91f7-5f1b7f18983a req-5ff27266-b2ea-4f57-9019-ce621d5177e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dce54f-84c2-4623-a137-e4337b192c67", "name": "network-vif-deleted", "tag": "c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4"}]} {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 04:54:00.939921 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2f8a59da-5adb-41eb-91f7-5f1b7f18983a req-5ff27266-b2ea-4f57-9019-ce621d5177e0 service nova] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:00.940416 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2f8a59da-5adb-41eb-91f7-5f1b7f18983a req-5ff27266-b2ea-4f57-9019-ce621d5177e0 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:00.940853 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [req-2f8a59da-5adb-41eb-91f7-5f1b7f18983a req-5ff27266-b2ea-4f57-9019-ce621d5177e0 service nova] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:00.956521 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.compute.server_external_events [req-2f8a59da-5adb-41eb-91f7-5f1b7f18983a req-5ff27266-b2ea-4f57-9019-ce621d5177e0 service nova] Creating event network-vif-deleted:c2c8923a-7056-4cd3-8919-0aa9fdbdc4c4 for instance 54dce54f-84c2-4623-a137-e4337b192c67 on hv-cinder-85600 Sep 09 04:54:00.962566 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [req-2f8a59da-5adb-41eb-91f7-5f1b7f18983a req-5ff27266-b2ea-4f57-9019-ce621d5177e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048024 Sep 09 04:54:00.963348 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 557/1108] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Sep 9 04:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 04:54:01.908633 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:54:01.909344 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.compute.api [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127437) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:54:01.916224 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:01.916798 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:01.917150 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:01.917858 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:01.918297 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:01.918758 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:01.950281 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:01.950761 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:01.951225 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG oslo_concurrency.lockutils [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:01.951669 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.objects.instance [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lazy-loading 'fault' on Instance uuid 54dce54f-84c2-4623-a137-e4337b192c67 {{(pid=127437) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 04:54:02.014299 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.policy [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deab6d2c9e1f429ca593f92669deab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78feec3c37b84399ba54e70b4e5a1e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127437) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 04:54:02.023449 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-d367f8fd-11d6-4813-ae2e-171727fe1712 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 200 len: 1225 microversion: 2.1 time: 0.118580 Sep 09 04:54:02.025238 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 552/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:54:01 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 04:54:03.051871 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '>' {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:54:03.052764 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.compute.api [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] [instance: 54dce54f-84c2-4623-a137-e4337b192c67] Fetching instance by UUID {{(pid=127436) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 04:54:03.059810 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:03.060367 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:03.060868 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:03.061634 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Acquiring lock "c8c5defc-d373-4759-8757-637e47363151" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 04:54:03.062300 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 04:54:03.062794 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG oslo_concurrency.lockutils [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Lock "c8c5defc-d373-4759-8757-637e47363151" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 04:54:03.078139 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.wsgi [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] HTTP exception thrown: Instance 54dce54f-84c2-4623-a137-e4337b192c67 could not be found. Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Request method failure captured: Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: request: GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 HTTP/1.1 Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept: application/json Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Accept-Encoding: identity Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Connection: close Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Length: 0 Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Content-Type: application/json Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Host: 10.222.0.20 Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: Openstack-System-Scope: None Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: User-Agent: python-urllib3/1.26.12 Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Auth-Token: gAAAAABjGsXYw8u3kcYR_9Bg9LYmMP7wREgLeZgOOyvRQuBL5eIQLOi_O26bozYXU7u-DyE899kEWcPCimkcA9wP4kqqZCla2G7X48X7zWkKtWFqm4fzrqfQNeCaGonAqcIgaADfVY7_4d3gEX_La5NVpfla_rzuW7-0-JBJtzIOw5FePWvSkUI Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Id: None Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Domain-Name: None Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Identity-Status: Confirmed Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Is-Admin-Project: True Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Id: default Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Domain-Name: Default Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Id: 78feec3c37b84399ba54e70b4e5a1e08 Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Project-Name: tempest-TestShelveInstance-1198286564 Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Role: reader,member Sep 09 04:54:03.079839 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Roles: reader,member Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/78feec3c37b84399ba54e70b4e5a1e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_78feec3c37b84399ba54e70b4e5a1e08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78feec3c37b84399ba54e70b4e5a1e08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78feec3c37b84399ba54e70b4e5a1e08"}]}] Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant: tempest-TestShelveInstance-1198286564 Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Id: 78feec3c37b84399ba54e70b4e5a1e08 Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-Tenant-Name: tempest-TestShelveInstance-1198286564 Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User: tempest-TestShelveInstance-1198286564-project Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Id: default Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Domain-Name: Default Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Id: deab6d2c9e1f429ca593f92669deab9c Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: X-User-Name: tempest-TestShelveInstance-1198286564-project Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: method: > Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: exception: Instance 54dce54f-84c2-4623-a137-e4337b192c67 could not be found. Sep 09 04:54:03.081589 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: action_args: {'id': '54dce54f-84c2-4623-a137-e4337b192c67'} Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: {{(pid=127436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54dce54f-84c2-4623-a137-e4337b192c67 could not be found. Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 04:54:03.085749 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54dce54f-84c2-4623-a137-e4337b192c67 could not be found. Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54dce54f-84c2-4623-a137-e4337b192c67 could not be found. Sep 09 04:54:03.088103 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: ERROR nova.api.openstack.wsgi Sep 09 04:54:03.089632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: DEBUG nova.api.openstack.wsgi [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Returning 404 to user: Instance 54dce54f-84c2-4623-a137-e4337b192c67 could not be found. {{(pid=127436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 04:54:03.089632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: INFO nova.api.openstack.requestlog [None req-94ee9093-aec8-4df1-b601-2ff6e2a46f90 tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67" status: 404 len: 111 microversion: 2.1 time: 0.034519 Sep 09 04:54:03.089632 dv-cinder-856002-3-iscsi devstack@n-api.service[127436]: [pid: 127436|app: 0|req: 558/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Sep 9 04:54:03 2022] GET /compute/v2.1/servers/54dce54f-84c2-4623-a137-e4337b192c67 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 04:54:03.245510 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: DEBUG nova.api.openstack.wsgi [None req-48ada5db-53ab-4637-a414-b209a624b04e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] Calling method '.version_select at 0x7f43fad3aee0>' {{(pid=127437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 04:54:03.272450 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: INFO nova.api.openstack.requestlog [None req-48ada5db-53ab-4637-a414-b209a624b04e tempest-TestShelveInstance-1198286564 tempest-TestShelveInstance-1198286564-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1201854408" status: 202 len: 0 microversion: 2.1 time: 0.032271 Sep 09 04:54:03.273397 dv-cinder-856002-3-iscsi devstack@n-api.service[127437]: [pid: 127437|app: 0|req: 553/1111] 10.222.0.20 () {58 vars in 1254 bytes} [Fri Sep 9 04:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1201854408 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)